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Preface 



This volume contains a selection of papers referring to lectures presented at 
the symposium “Operations Research 2003” (OR03) held at the Ruprecht- 
Karls-Universität Heidelberg, September 3-5, 2003. This international con- 
ference took place under the auspices of the German Operations Research So- 
ciety (GOR) and of Dr. Erwin Teufel, prime minister of Baden-Württemberg. 

The symposium had about 500 participants from countries all over the world. 
It attracted academians and practitioners working in various field of Opera- 
tions Research and provided them with the most recent advances in Opera- 
tions Research and related areas in Economics, Mathematics, and Computer 
Science. 

The program consisted of 4 plenary and 13 semi-plenary talks and more than 
300 contributed papers selected by the program committee to be presented 
in 17 sections. 

Due to a limited number of pages available for the proceedings volume, the 
length of each article as well as the total number of accepted contributions 
had to be restricted. Submitted manuscripts have therefore been reviewed 
and 62 of them have been selected for publication. This refereeing procedure 
has been strongly supported by the section chairmen and we would like to 
express our gratitude to them. 

Finally, we also would like to thank Dr. Werner Müller from Springer- Verlag 
for his support in publishing this proceedings volume. 
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Assessing Capacity Improvements 
by Relaying in Cellular Networks* 



Hans-Florian Geerdes 

Konrad- Zuse- Zentrum für Informationstechnik, Berlin, Germany 



Abstract. Relaying - allowing multiple wireless hops - is a protocol extension 
for cellular networks conceived to improve data throughput. Its benefits have only 
been quantified for small example networks. For assessing its general potential, 
we define a complex resource allocation/scheduling problem. Several mathematical 
models are presented for this problem; while a time-expanded MIP approach turns 
out intractable, a sophisticated column generation scheme leads to good computa- 
tional results. We thereby show that for selected cases relaying can increase data 
throughput by 30% on the average. 



1 Introduction 

The amount of data that can be sent per time in wireless computer net- 
works (wireless LANs, WLANs) is limited by bandwidth restrictions and by 
interference. Many researchers strive to use the available resources more effi- 
ciently in order to increase data throughput. One technique conceived to do 
so is relaying . 



1.1 Relaying in Cellular Networks 

Wireless telecommunication networks fall into two categories: ad hoc net- 
works (Fig. 1(a)) and cellular networks (Fig. 1(b)). In ad hoc networks, the 
mobile nodes organize their usage of the radio network themselves, whereas 
in cellular networks this task is carried out by an infrastructure of fixed base 
stations. In contrast to ad hoc networks, this implies that mobile nodes may 
never exchange data directly, they are only allowed to transmit data to and 
receive data from their respective base station. 

Relaying means to allow multiple wireless hops for data to reach its des- 
tination. While this is quite common in most ad hoc networks, it is normally 
not used in cellular ones. To use relaying in cellular computer networks can 
be beneficial because transmission speed can be adapted - several fast hops 
might be better on the overall than one slow one. Within this work, however, 
we still rely on the the main feature of cellular network organization, namely 
organization in space and in time by the base station infrastructure. 

* Supported by the DFG research center “Mathematics for key technologies” (FZT 
86) in Berlin. 
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(a) Ad hoc network 

Fig. 1 




(b) Cellular network (c) Relaying in cellu- 

lar networks 

Mixing communication paradigms 



1.2 The Potential of Relaying 

For special network arrangements, it has been shown that using relaying 
can increase the data throughput in particular cases by up to 60% [3]. The 
method presented there to analyze the achievable data throughput gain is to 
find best-possible transmission schedules a) with and b) without relaying and 
compare the resulting data throughput. However, the average achievable ad- 
ditional data throughput by allowing relaying as well as a method to solve the 
scheduling and resource allocation problem for general networks are yet un- 
known. This work develops linear and mixed integer programming models for 
the problem as well as adapted algorithms and uses these tools to assess the 
average potential of relaying in arbitrary networks. Some work on scheduling 
and routing in ad hoc networks uses similar models of the problem, see e.g. 
[1,6,5], a literature survey can be found in [2]. 

2 Formulating the Optimization Problem 

We now outline the scheduling and resource allocation problem we solve 
to assess the potential of relaying in cellular networks. The details of our 
model and its computational parameters are based on HiperLAN/2 radio 
technology [4]. The results, however, apply essentially to any other modern 
WLAN technology. 



2.1 Transmission Schedules and Data Throughput 

Our objective is to maximize data throughput in the uplink , that is, we want 
to transmit as much data to the base station as possible in a fixed period 
of time of T unit time slots. (We assume that each mobile has an unlimited 
amount of data to send to its base station.) Data throughput is assigned 
to the mobiles by specifying a global transmission schedule for the network. 
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A transmission schedule consists of a set of transmission commands , that 
specify all parameters for transmitting a single, atomic data unit. For each 
transmission we have to choose the sender and receiver, the transmission 
power, and the transmission speed. The last parameter can actually not be 
chosen freely, but there is a fixed set M of physical modes (six in Hiper- 
LAN/2) to pick from. The number of time slots needed to transmit one data 
unit varies for the different physical modes, we will denote it by l m G N for 
a mode m € M. The transmission power has to be picked from a (hardware 
dependent) interval [P m in?Pmax]- 

An important limitation to the feasibility of transmission schedules is 
posed by interference. The amount of interference is normally measured rel- 
ative to the strength of the desired signal (Signal-to-Interference-and-Noise 
Ratio, SINR). We simplify the relation between SINR and transmission suc- 
cess and assume that a transmission is successful if and only if the SINR 
stays above a certain threshold £, that is, 



Received Signal 
^2 Interfering Signals + v 



>im 



(SINR) 



The term v here stands for an omnipresent amount of thermal noise. The 
threshold £ m varies, it is higher for faster physical modes - higher transmis- 
sion speed comes at the cost of increased error liability. 



2.2 Fairness 

If we only strive to maximize the amount of data that is transmitted to 
the base station, the resulting schedules will be quite unbalanced: stations 
that are close to the base station will get all the data throughput ( and we 
would never observe relaying). As this behavior is unwanted, we need to add 
fairness conditions to our problem that ensure that each terminal gets a share 
of the overall throughput. The actual modeling of fairness is crucial; different 
fairness models will lead to quite different results. We have implemented two 
different notions that form the two extremes of the spectrum in which fairness 
can be conceived: 

Time Share Fairness. No terminal should get more throughput than it 
would get if the available time was split equally between all mobiles and 
transmission conditions were optimal (that is, it could use the fastest 
physical mode). On the other hand, no user should get less throughput 
than it would get under fair time share if it had to use the slowest physical 
mode. 

Total User Fairness. All stations get the same throughput (and this com- 
mon throughput is to be maximized). This corresponds roughly to max- 
imizing the minimum throughput that any station gets. 
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3 Mathematical Models 

We now describe mathematical models for the relaying problem. We start 
with a mixed integer model of feasible transmission conditions at a single 
instance in time; we then develop two different complete models that rely 
on this basic model and incorporate the time component. The structure and 
relation between our models is outlined in Fig. 2. 




(LP) 



(PR) 



(a) Transmission (b) Time-Expanded 
Feasibility MIP 



(c) Column Model 



Fig. 2. Structure of Models 



3.1 Feasible Transmission Conditions: 
a Basic Mixed Integer Model 

All possible transmissions are denoted by binary variables x € {0, 1}, and 
the associated transmission power is specified in related variables p. If x = 1, 
this means that the referring transmission takes place, otherwise it is not 
scheduled. We denote the set of all stations by S and the set of available 
physical modes by M. The index set of all possible transmissions - sketched 
in Fig. 2(a) - is 

I:=MxSxS. 

We have as variables 

Pmij C [0, P max ] V (m,i,j) el, 

Xmij € {0,1} V € I. K ' 

For any assignment of these variables to form a feasible transmission schedule, 
we first need to ensure some simple, combinatorial conditions. Any station 
might only send or receive at the same time: 

EE ( %mij H" % mji ) ^ 1 V % £ S . (B.2) 

j£S m£M 

Furthermore, the semantics and relation between x and p variables have to 
be guaranteed, that is, 

P min %mij — Pmij — P ma x^mij ^ (m,i,j)el. (B.3) 
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The most complex set of constraint enforces the interference conditions 
(SINR). Since these conditions must only be active for actually scheduled 
transmissions (x = 1), we add a “switching” term containing a bound SGqo 
such that the constraint is only sharp if the referring transmission is sched- 
uled. Writing 7 ^ for the channel attenuation of transmission power between 
two stations i,j € S we obtain 



/ 



'YijPmij “I“ £mSGoo(l %mij ) ^ s/i 



\ 



E IfsiPnsr 

l (n,s,r) I 

\ 7 Hm,i,j) / 



V ( m,i,j ) € I. 

(BA) 



3.2 Time-Expanded Mixed— Integer Model 

When compiling a transmission schedule, we have to ensure that feasible 
transmission conditions prevail at all times. A simple way to do so is to copy 
the basic model for each time slot. We get variables x m ijt and Pmiju where 

te{l,...,T} 

denotes the time slot, and we understand x m ijt = 1 as “Station i begins to 
transmit a data unit to station j at time t , using modulation m.” Trans- 
mission will then be finished at time t 4- Z m . The construction is depicted in 
Fig. 2(b). 

We furthermore take T copies of the constraints and substitute the term 

^ ^ %mijs 
t<s<t+l{m) 

for all occurrences of x m ij in the basic equations (B.2)-(B.4) at each time slot 
t. This provides the necessary link between overlapping transmissions. The 
time-expanded model including the formulation of the respective objective 
functions is presented in full detail in [2]. However, computational experi- 
ments showed that the model dimensions make the problem intractable for 
any nontrivial problem instances. 



3.3 Column— Based Model 

We now present a more sophisticated general model that uses the basic model 
for the pricing subproblem in a column generation scheme. The results, how- 
ever, are approximations of actual transmission schedules and have to be 
rounded. The structure of this model is shown in Fig. 2(c). 
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Combining Transmission Patterns 

The model we use has two tiers. The first tier, formulated as a linear program 
(LP), is responsible for finding a good distribution of the available time to 
all possible transmission patterns. A transmission pattern is a feasible set of 
concurrent transmissions and corresponds to a feasible solution (x*,p*) of 
our basic model (B). The data throughput that each Station i G S achieves 
per time unit for any given transmission pattern is summarized in a matrix 
The column corresponding to (x*,p*) is constructed by letting 



:= E E 0C« - Am V i e S . (1) 

j€S m€M 

Due to the constraints (B.2), at most one of the variables x in the sum is 
different from zero. The result measures how much data station i puts 

on the network or receives from another station (negative data throughput) 
per time unit under a specific transmission pattern. 

We write the problem of finding a time weighting r) of all possible trans- 
mission patterns as a linear program. The matrix is used to calculate the 
net data throughput that any station achieves. We sketch the model for the 
second fairness model (total user fairness), a full explanation and the model 
for the alternate fairness concept can be found in [2]. After adding an aux- 
iliary variable ä to count the minimum data throughput our optimization 
problem reads 



max a 

s.t. 1 T 77 < T 
<Prj > ä 

T] > 0 



(LP) 



Since we can only find a fractional time weighting 77 within this model, the 
resulting transmission schedule does not take into account that data units 
cannot be split in reality. A simple rounding-off procedure to cast the result 
to feasible transmission schedules with tolerable rounding loss is described 
in [2]- 



The Pricing Problem 

The matrix in the model (LP) has as many columns as there are feasible 
assignment of x variables in (B). These are too many to be considered explic- 
itly, we therefore use a column generation approach. We start with a reduced 
set of columns, solve (LP), and calculate the dual variables ( y *,w*) (where 
y corresponds to the time constraint and w to the constraints <f>r\ > ä). We 
use these dual variables to determine whether there are any columns that 
are not considered yet but could improve the objective of (LP). This prob- 
lem is commonly called the pricing problem within the framework of column 
generation. This pricing problem, that is, the search for helpful transmission 
patterns, constitutes the second tier of our model. 
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By writing down the dual problem of (LP) we see that ( y*,w *) is feasible 
- which in turn means that the set of considered columns is sufficient - if and 
only if 



max 

x feasible in (B) 
with suitable p 




W7 — Wa 



%mij — V • 



(PR) 



We can thus solve the pricing problem by adding the left hand side of (PR) 
as the objective function to (B) and comparing the optimal value to y * . If 
the inequality holds true, we are done. Otherwise we can use the vector x to 
construct a new column for (LP) as in (1). 



4 Results 

We implemented a column generation algorithm based on the model described 
in the previous section that computed almost optimal relaying schedules for 
special network configurations within a few hours on a standard PC (with an 
approximation of a few percent). The details can be found in [2]. The main 
computational work was to solve the pricing problem (PR) at late stages. 





(a) Time share fairness: 
throughput gains of 
10 % 



(b) Total user fairness: 
throughput gains of 
30% 



Fig. 3. Computational results 



For selected classes of networks this implementation was used to quantify 
the average throughput gains by relaying. This was carried out by statisti- 
cally analyzing the results for many “snapshots” of concrete configurations 
of mobiles hosts. For the first fairness model, fair time share, the result can 
be seen in Fig. 3(a); the average throughput gain of about 10% is rather 
small. This is because this fairness model favors mobiles that are close to the 
base station, and these mobiles are unlikely to use relaying. In the total user 
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fairness model, on the other hand, the gain amounts to about 30%. (All error 
bars represent 5% confidence intervals.) 



Conclusions 

We have presented mathematical programming models to solve a complex 
routing and scheduling problem for wireless cellular networks. These mod- 
els, were used to exemplarily show that the use of relaying can significantly 
improve data throughput in wireless LANs. This result represents a strong in- 
centive to further develop the relaying approach on the technical side. Further 
work could, among others, focus on distributed algorithms or investigation 
of the influence of the fairness concept. 
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Abstract. Many call centers provide service for customers of different classes. 
We analyze a queueing model of an inbound call center with two customer classes, 
three agent groups, and skills-based routing. In our model we assume that a waiting 
customer may hang up before his service begins. All times are assumed to be expo- 
nentially distributed. We describe the states and the state space of this continuous 
time Markov chain and develop the steady-state equations. The behavior of this 
system is analyzed in numerical experiments and optimal economical allocations of 
the agents are discussed. 



1 Introduction 

Call centers provide phone-based services to customers or clients in the pri- 
vate or public sector. During the past years, the number of call centers and 
the number of agents has grown rapidly, demonstrating the increasing im- 
portance of call centers. By the direction in which the contact between the 
customer and the agent is initiated, we distinguish inbound and outbound 
call centers. In inbound call centers the employees or agents receive calls from 
outside customers, and therefore these call centers are driven by random cus- 
tomer call arrivals. 

The performance of inbound call centers can be measured by technical 
performance measures such as waiting times, availability of service, or cus- 
tomer abandonment. These technical performance measures improve if the 
call center management employs more agents. However, the operating costs 
of call centers are mainly driven by the costs of these agents. About 60 to 70 
percent of the operating costs are personnel-related. Call center management 
has to adjust imbalances of acceptable technical performance measures and 
the economic performance of the call center. Both the number of agents and 
the number of offered phone lines are important decision variables in this 
context. 

Research in different scientific disciplines is related to call centers, for 
example, studies in Operations Research, Marketing, or Information Tech- 
nology, see the comprehensive research bibliography of call center-related 
literature of Mandelbaum [8] . An overview of formal models and operational 
planning problems in call centers is given by Gans et al. [2], Helber and 
Stolletz [4,5], and Stolletz [11]. 
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Many inbound call centers provide service for heterogeneous customers 
with heterogeneous agents. In such call centers, the customers can be routed 
to different agent groups and the agents can serve customers of different 
classes, which is referred to as skills-based routing . As an example of skills- 
based routing, this paper analyzes a queueing model of an inbound call center 
with heterogeneous customers and heterogeneous agents, the so-called M- 
design. In Section 2, we describe this queueing model with the considered 
routing policies. A summary of the derivation of steady-state probabilities 
and technical as well as economic performance measures is given in Section 3. 
Section 4 presents some numerical results. 



2 Description of the Queueing Model 

This section describes a model of an inbound call center with two classes 
(A and B) of customers and three different groups of agents, as depicted in 
Figure 1. This queueing system is completely described by customer profiles, 
agent characteristics, routing policies, and the limitation of the waiting room. 
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Fig. 1. Schematic model of an M-design call center 



Customer Profiles: A-customers and B-customers arrive at the system 
according to independent homogeneous Poisson processes with arrival rates 
A a and A b, respectively. It is assumed that customers of both classes are 
impatient. If an arriving A-customer cannot reach an agent immediately, he 
balks with probability Pa or joins the queue with probability 1 — Pa- A B- 
customer balks with probability Pb or joins the queue with probability 1 ~Pb- 
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A waiting customer of any class reneges after an exponentially distributed 
waiting time limit, if the service has not begun. Let va and v B be the rates 
of these distributions of the waiting time limits for A- and B-customers, 
respectively. Abandoned customers are assumed to be lost, i.e., there are no 
retrials. 

Agent Characteristics: The three groups of agents have different skills. 
Each agent belongs to just one group and works with exponentially dis- 
tributed processing times. The ca agents of the first group are specialists 
for A-customers and each agent works with an average processing rate f. la • 
The cq flexible agents of the second group are generalists crosstrained for A- 
as well as for B-customers. Each generalist works with an average processing 
rate Ji A for A-customers and Jß B for B-customers, respectively. The c B agents 
of the third group are specialists for B-customers and each agent of this group 
works with an average processing rate fi B . 

Routing Policies: There are two kinds of routing policies describing 
the service system. The agent selection policy describes how a calling cus- 
tomer is routed. The question of which waiting customer is served next if 
an agent becomes available is answered by the customer selection policy. For 
agent selection , we assume a preferred- agent-group policy for both customer 
classes. If a specialist is available, an arriving customer will be served im- 
mediately by him. Otherwise, if all specialists are busy, but a generalist is 
available, this flexible agent serves the arriving customer. If all specialists 
for this class of customers and all generalists are busy, the arriving customer 
joins the queue or balks. For customer selection , we have different rules for 
specialists and generalists. The specialists serve customers according to the 
First-Come-First-Served rule within their particular class. If a generalist be- 
comes available, he serves a waiting customer according to a priority rule. The 
generalist looks at the A-queue first. If an A-customer is waiting, the gen- 
eralist serves an A-customer according to the First-Come-First-Served rule. 
Otherwise, the generalist looks at the B-queue and serves a B-customer ac- 
cording to the First-Come-First-Served rule. If there is no customer in queue, 
the generalist idles. Therefore, the routing policies follow a non-preemptive 
priority rule for high-priority A-customers. 

Limitation of the Waiting Rooms: Each class of customers has its own 
queue. We assume that the maximum number Ka of A-customers (waiting 
and in service) is finite. The maximal number K B of B-customers in the 
system is finite as well. This limitation of the system size with completely 
partitioned waiting rooms is motivated by a given number of telephone trunks 
for each class of customers. 

This model, with all the described features, is analyzed in [11]. In the lit- 
erature, queueing models of an M - design are analyzed with patient customers 
only. An M-design without any waiting positions is considered by Sato and 
Mori [10], Kawashima [7], and Pinker and Shumsky [9]. A loss- waiting sys- 
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tem is analyzed by Gurumurthi and Benjaafar [3], but they assume that the 
generalists serve both customer classes with the same mean processing time. 

3 Derivation of Steady-State Performance Measures 

The stochastic process of the considered call center model is a Markov process, 

i.e., future behavior depends only on the present, not the past. We analyze the 
model in steady-state where the probabilities of the different system states do 
not change over time. A representation of the states of this queueing system 
must contain information about the number of waiting customers of each 
class, the number of busy specialists of each class, the number of generalists 
serving A-customers, and the number of generalists serving B-customers. We 
describe the states of the system using a quadruple (z, j, &, /), where 

• z is the number of A-customers in the system (waiting and in service), 

• j is the number of B-customers in the system (waiting and in service), 

• k is the number of generalists serving A-customers, and 

• l is the number of generalists serving B-customers. 

The number of busy specialists and the number of waiting customers for a 
given state can be derived from the corresponding tuple (z, j, fc, Z) as 

• min{z — &, ca} for the number of busy A-specialists, 

• min {j — /, cb} for the number of busy B-specialists, 

• max{z — k — ca, 0} for the number of waiting A-customers, and 

• ma x{j — l — cb, 0} for the number of waiting B-customers. 

Therefore, the quadruple (z,j, k,l) describes the state completely. Steady- 
state equations of states with waiting customers have a common basic struc- 
ture, but differ structurally from those equations for states without waiting 
customers. Therefore, we divide the state space S into the following four 
regions: 

1. Region I: States (i,j, k,l) G S with waiting customers of both classes 

2. Region II: States (i,j,k,l) G S with waiting A-customers and without 
waiting B-customers 

3. Region III: States (z,j, k, l) G S with waiting B-customers and without 
waiting A-customers 

4. Region IV: States (z, j, k, l) G <S without waiting customers 

Let p(z, j, fc, /)) be the steady-state probability to be in state (z, j, fc, /) G S. 
The derivation of general steady-state equations for each region is given in 
[11]. To solve the resulting set of all steady-state equations, we apply the 
power method. This iterative approach can be applied for discrete-time Mar- 
kov chains, see Bolch et al. [1] pp. 132-136. To use the power method for 
continuous-time Markov chains, we transform the basic problem via uni- 
formization, see [1] pp. 103-104. The continuous-time Markov chain which 
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we analyze is irreducible and finite. Therefore, the Markov chain is ergodic 
and the power method converges. 

Within the resulting steady-state probabilities, some technical perfor- 
mance measures can be derived for both customer classes. The expected 
number of waiting customers is the sum of the queue lengths L(z ) weighted 
by their steady-state probabilities p (z) over all states z G S. To derive the 
expected length E [La] of the A-queue, the sum goes over all states with wait- 
ing customers of both classes (Region I) and states with waiting A-customers 
and no waiting B-customers (Region II), i.e., 



cg Ka Kb 

E[£a] = Y Y Y (i-k-c A )p(i,j,k,c G -k). (1) 

k= 0 i=CA+k+l j—ca — k 



A calling A-customer receives service immediately if there is at least one 
available A-specialist or generalist. Therefore, the probability of receiving 
service immediately is 



P(Wa = 0)= Y P (i,j,k,l) 

(ij,k,l )£ Region III: i^CA+k 

+ Y P (i,j,k,l). (2) 

Region IV: i^CA+k or CG^k+l 



Other performance measures can be derived similarly for A- as well as for 
B-customers. Besides these performance measures for each customer class, we 
analyze weighted performance measures for both customer classes together. 
A measure for a particular class is weighted by the fraction of calling cus- 
tomers in this class. For example, the weighted probability of receiving service 
immediately Pa+b{W = 0) is given by 



P A+B (W = 0)= ^P(^=0) + ^ p (W B = 0) 

Based on these technical performance measures, we can derive economic per- 
formance measures of the call center. Dependent on the used service numbers 
we distinguish three classes of services: toll-free, shared-cost, and value-added 
services, see Helber et al. [5,6]. If we consider a sales call center providing 
service via toll-free or shared-cost numbers, the cost function consists of tele- 
phone costs and agent costs. Let C UA and C UB be the telephone cost per time 
unit for an A- and a B-customer on hold, respectively. For the cost of an 
agent per time unit we use the notation C A , C B , and C G for agents of the 
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particular group. Then we have the cost function 

C(ca, cb,cg, Ka , Kb) = (E[Xa] + ca E[ma] + cq 'E[ug a ]) C ua 

telephone costs for A-customers 

+ (E[iß] + cb E{wb] + cg E[«g b ]) C Ub 

telephone costs for B-customers 

-\-C A ca + C B cb 4- C G cg, (4) 

v ' 

agent costs 

where E [ua\ and E[ub] are the expected utilizations of the specialist groups. 
E [ug a ] an< 3 E[ug b ] are the expected utilizations of the generalists with A- 
and B-customers, respectively. 

A call center can generate revenue per served customer, for example in 
a sales call center. We consider the case, where the expected revenue Vß A 
and 7lß per served customer is independent of the talk time. We derive the 
expected revenue per time unit via the probabilities of receiving service, i.e. 

TZ s (ca,cb,cg,K a ,K b ) = A a Pa{ service )H S A + XbPb( service )TZ%. (5) 
The difference of the revenue (5) and the costs (4) gives the profit V. 

4 Numerical Results 

In this example, we show how the allocation of a fixed number of agents into 
the three agent groups influences technical as well as economic performance 
measures. Consider a call center with c = ca + cb + cg = 20 agents. The 
arrival rates are assumed to equal Xa = = 300 calls per hour. We assume 

that waiting customers of both classes renege after an average waiting time 
of 20 seconds, i.e., v A l = = 20 seconds. Specialists and generalists may 

have different skill levels such that the average processing times differ. The 
generalists are trained to handle both types of customers. This might result 
in greater processing times for the generalists. We assume that the specialists 
of both groups have an average processing time of fi~^ — fig 1 = 100 seconds, 
and a generalist needs on average 20 seconds more to handle a call, i.e., 
IT7 1 = 71 r 1 = 120 seconds. We assume that the numbers of telephone trunks 
are K A = K B = 30 . 

Now, we vary the number of agents ca , c#, and cg such that each group 
is staffed with at least one agent, and all 20 agents belong to one of the 
agent groups, i.e., c = ca 4 - cb + cg = 20 . Figure 2 depicts the weighted 
probability Pa+b(W — 0) of receiving service immediately. This probability 
has a maximum of Pa+b(W = 0 ) = 78 . 23 % for the allocation ca = cb = 8 
and cg — 4. If the call center is staffed very asymmetrically, i.e., we have 
many specialists in only one agent group, the probability Pa+b(W = 0) is 
relatively low. 
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Fig. 2. Weighted probability of receiving service immediately for allocations of 
c = 20 agents 



Table 1 . Optimal allocation of agents, such that each agent group is staffed with 
at least one agent and c = ca + cb + cg = 20 



Va — &B 
[sec] 


ca 


c*b 


cb 


V(c\,c* B ,cb) 
[euros /min.] 


c-a 


Pa+b (service) 
[%] 


C A+ C B+ C G 

[%} 


120 


1 


1 


18 


78.52 


90 


87.34 


115 


3 


3 


14 


78.82 


70 


87.61 


110 


6 


6 


8 


79.79 


40 


88.51 


105 


7 


7 


6 


81.13 


30 


89.78 


100 


7 


7 


6 


82.59 


30 


91.21 


95 


8 


8 


4 


84.12 


20 


92.64 


90 


8 


8 


4 


85.60 


20 


94.06 



In Table 1 we analyze how the economic performance of such a call center 
depends on the processing times of the agents. We consider a profit function 
V of a sales call center described in Section 3. We assume telephone costs of 
C UA = C UB = 0.12 euros per minute and agent costs of C A = C B = C G = 20 
euros per hour. A served customer generates an expected revenue of 1Z S = 10 
euros, independent of the customer class. Table 1 gives the economically 
optimal allocation of c = 20 agents for different mean processing times of the 
specialists and impatient customers (z/^ 1 = v^ 1 — 20 seconds). A generalist 
provides service with an average processing time of = Jl g 1 = 120 seconds. 

If the mean processing time of the specialists decreases, the percentage of 
generalists in the optimal allocation decreases as well. Hence, the effects of 
pooling decrease, and the influence of advantages of shorter processing times 
on the profit function increases. The last column of Table 1 gives the weighted 
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probability Pa+b (service) of receiving service. If the average processing time 
of the specialists decreases, more customers of both classes receive service. 

Although a generalist needs more time to serve a customer than a special- 
ist, the optimal allocations have more than one generalist. This holds with 
respect to a single performance measure as well as for the profit function of a 
sales call center. However, for an increasing difference between the mean pro- 
cessing times of specialists and generalists, the advantages of pooling agents 
into a group of generalists decrease. 



References 

1. Bolch, G., Greiner, S., de Meer, H. and Trivedi, K. S. (1998). Queueing net- 
works and Markov chains: Modeling and performance evaluation with computer 
science applications. John Wiley & Sons, Inc., New York et al. 

2. Gans, N. and Koole, G. and Mandelbaum, A. (2003). Telephone Call Centers: 
Tutorial, Review, and Research Prospects. Manufacturing Sz Service Operations 
Management, 5(2):79-141. 

3. Gurumurthi, S. and Benjaafar, S. (2001). Modeling and Analysis of Flexible 
Queueing Systems. Department of Mechanical Engineering, Division of Indus- 
trial Engineering, University of Minnesota. 

4. Helber, S. and Stolletz, R. (2001). Grundlagen der Personalbedarfsermittlung 
in Inbound-Call Centern. To appear in: Zeitschrift für Betriebswirtschaft. 

5. Helber, S. and Stolletz, R. (2003). Call Center Management in der Praxis. 
Strukturen und Prozesse betriebswirtschaftlich optimieren. Springer- Verlag, 
Berlin et al. 

6. Helber, S., Stolletz, R. and Bothe, S. (2002). Erfolgszielorientierte Agente- 
nallokation in Inbound Call Centern. To appear in: Zeitschrift für betrieb- 
swirtschaftliche Forschung. 

7. Kawashima, K. (1985). An approximation of a loss system with two hetero- 
geneous types of calls. Journal of the Operations Research Society of Japan , 
28(2):163-177. 

8. Mandelbaum, A. (2003). Call Centers (Centres). Research Bibliography with 
Abstracts. Industrial Engineering and Management, Technion, Haifa 32000, Is- 
rael. URL: http://ie.technion.ac.il/serveng. 

9. Pinker, E. J. and Shumsky, R. A. (2000). The Efficiency- Quality Trade-Off 
of Cross-Trained Workers. Manufacturing Sz Service Operations Management , 
2(l):32-48. 

10. Sato, T. and Mori, M. (1983). An Application of the Lumping Method to a 
Loss System with Two Types of Customers. Journal of the Operations Research 
Society of Japan, 26(l):51-59. 

11. Stolletz, R. (2003). Performance Analysis and Optimization of Inbound Call 
Centers. Lecture Notes in Economics and Mathematical Systems, Vol. 528. 
Springer- Verlag, Berlin et al. 




Revenue Management in Manufacturing 



Florian Defregger and Heinrich Kuhn 

Catholic University of Eichstätt-Ingolstadt, 85049 Ingolstadt, Germany 



Abstract. Revenue Management has proven successful in a number of service in- 
dustries such as airlines, hotels and cruiseships. This paper examines the possibility 
of applying revenue management techniques to a manufacturing setting. A make- 
to-order company is considered which receives orders with different profit margins, 
processing times and due dates. The corresponding discrete markov decision pro- 
cess model is presented as well as a heuristic which solves large problem instances 
within a reasonable runtime. 



1 Introduction 

Revenue Management originates in service industries like the airline and hotel 
businesses. Here we explore the possibility of applying revenue management 
techniques to a manufacturing company [1]. We consider a make-to-order 
company with high fixed costs. Figure 1 shows an example of the decision 
process. 
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Fig. 1. Order Selection Process 



Stochastic orders, each with its own profit margin, lead time and process- 
ing time arrive at the company which has to decide which orders to accept 
and which ones to refuse. Accepting too many orders with low profit margins 
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might clog the production capacity so much that orders with higher profit 
margins will have to be turned down once they arrive. In order to avoid this, 
some orders with low profit margins should be rejected even if capacity to 
accept them is available. But if too many of those orders are rejected the 
company might lose money as well. Thus the company has to decide in which 
situations orders with lower profit margins should be rejected. 

2 Model 

Kniker and Burman [2] present an infinite-horizon markov decision process 
model which is characterized as follows. All orders arriving at the company 
belong to a certain order class n G {1, . . . , N}. In each discrete time period 
at most one order can arrive with probability p ni J2n=iPn < 1 • All orders 
of class n have a profit margin of m n monetary units, a processing time of 
r n a lead time of l n time periods. The lead time specifies that the customer 
is willing to wait for a maximum of l n time periods when placing the order 
at the company. To model the case that no order arrives in a given period, 
the dummy order class 0 is used, po = 1 — Yln=iPm m ° — r o = lo = 0. 

Each system state is characterized by (n, c), with n being the order class 
which has arrived at the beginning of the current period and c being the 
number of periods the capacity is booked out by orders which have already 
been accepted and not been completed yet, c G {0, . . . , max nG | 1) In}- 
The set of all system states is denoted by S, \S\ = (N -f 1) • max nG { 1? ln- 

The state-dependent actions A of the markov decision process are given 
by 



A{{n,c)\ 



A1 := ” reject” 

A2 := ’’accept” : n > 0 Ac + r n <l n 



Orders can always be rejected, in the case no order arrives Al has the 
meaning of ’’wait for the next order to arrive” . An order can only be accepted 
if the order can be finished within the lead time l n . 

Action- and state-dependent rewards R are given by 



R A1 [(n,c)\ = 0, V(n, c) G S 
R A2 [(n,c)] = ra n , V(n, c) G S 

The company receives a reward of m n if it accepts an order of class n, 
otherwise there is no reward. 

The transition probabilities in the case of rejecting an order are: 



P A1 [(n,c),(m,c- !)] 



Pm, V(n, c) e {S :c^0},m€ {0, . . . , N} 
0, else 
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P A1 [(n,0),(m,0)} 



Pm, Vn, TO e {0, . . . , N} 
0, else 



By rejecting an order or waiting for the next order to arrive the capacity 
usage c is decreased by 1. If c = 0, c stays 0. 

The transition probabilities for accepting an order are: 



P A2 [(n , c), (to, c + r n - 1)] 



Pm, V(n, c) e S, m e {0, . . . , N} 
0, else 



When accepting an order, c is increased by r n , but will be decreased by 
1 in the next period because of the ongoing production. 

By solving the markov decision process an optimality criterion is opti- 
mized by finding the optimal policy 7 r which maps an optimal action to each 
state (n, c). 

The optimality criterion chosen is the average reward per period which can 
be maximized by standard methods like policy iteration or value iteration. As 
the runtime of these algorithms increases quickly with larger |Sj, a heuristic 
is needed for large problem instances. 



3 Heuristic 

Let n G {1 , ...,iV} be the order classes sorted ascending by their relative 
profit margins m n /r n (this can easily be achieved by rearranging the order 
classes accordingly). 

The assumption is made that by gradually rejecting orders of the classes 
{1, . . . , N} the average reward increases monotonously to a global optimum 
and decreases monotonously after that. This is illustrated for 2 order classes 
in Figure 2. 

Starting out with the FCFS-Policy, which accepts all incoming orders as 
long as their leadtimes are not violated, orders are gradually rejected in class 
1 until reaching a global optimal average reward at c = 5. By rejecting even 
more orders, the average reward decreases. 

The average reward curve includes for each order class n all the capacity 
usages c where orders can be accepted. For each order class, orders can be 
accepted as long as the lead times are not violated, i.e. c < l n — ^n- Thus, for 
each order class n, c ranges from 0 to l n — r n . 

Each dot is associated with a specific machine usage c and order class 
n and symbolizes the policy of rejecting orders in states ’’left to it” and 
accepting orders in states ’’right to it” on the graph. Each of these policies 
has an average reward associated with it. 

For example, the policy with the highest average reward at n — 1 and 
c — 5 means that the company should reject orders of order class 1 as long 
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Average Reward 




I 

FCFS-Policy 



Fig. 2. Assumption about the Average Reward Curve 



as the current capacity is booked out for more than c = 5 periods and accept 
orders of class 1 otherwise. All orders of class 2 should be accepted. 

The heuristic starts by numbering all policies from 1 to P, with P being 
the number of policies given by 



N 

P = - n + 1) 

i= 1 




Fig. 3. Sequence of Comparisons 



As shown in Figure 3, the policies for the example given are numbered 
from 1 to 15. After numbering the policies the heuristic tries to find the 
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assumed global optimal policy by comparing policies pairwise. Each pairwise 
comparison is done by simulation, following the paired-t confidence interval 
approach [3] . During each comparison the average rewards of the two policies 
concerned are compared until a significant difference has been detected or the 
two average rewards differ by less than 0.5%. Figure 3 illustrates the sequence 
of pairwise comparisons that the heuristic might typically take. 



4 Numerical Results 

Numerical results for the heuristic are presented in Table 1. Calculations 
were carried out on a 233-MHz Pentium machine. The performance of the 
heuristic was compared to a standard solution procedure for markov decision 
processes, namely value iteration. The average reward obtained by value iter- 
ation deviated at most 0.1% from the optimal average reward of the markov 
decision process. For 64000 states this maximum deviation was lowered to 
1%, 3% and 5% in order to show how the runtime of value iteration would 
behave with these percentages. 

The examples show that the heuristic is able to solve even large problem 
instances in reasonable runtimes. The heuristic misses optimal solutions at 
high numbers of states because it limits its search to policies on the average 
reward curve shown in Figures 2 and 3. Other policies which implement 
individual booking limits for each order class n are possible, though, and 
might achieve higher average rewards as is demonstrated for \S\ = 64000. 



Table 1 . Numerical Results 



\S\ 


Average Reward 


Runtime [sec.] 


Value Iteration 


Heuristic 


% Diff. 


Value Iter. 


Heuristic 


1000 


7.617 


7.610 


0.09% 


67 


45 


2000 


7.889 


7.891 


-0.03% 


360 


66 


4000 


2.788 


2.760 


1% 


464 


169 


8000 


1.646 


1.646 


0.01% 


2052 


444 


16000 


0.540 


0.535 


0.93% 


8395 


529 


32000 


1.013 


1.010 


0.36% 


23352 


625 


64000 


0.716 


0.688 


4.14% 


115495 


562 


64000 


0.715 [1%] 


0.688 


3.93% 


76883 


562 


64000 


0.713 [3%] 


0.688 


3.61% 


59364 


562 


64000 


0.712 [5%] 


0.688 


3.52% 


48741 


562 
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Abstract. We consider a Network Revenue Management Problem with uncertain 
demand and nested capacity control. The objective is to maximize expected revenue 
by setting nested booking limits bj for all products j = 1, . . . , n. For this setting, no 
closed form for the objective function is known. In this paper, we propose a method 
to derive upper and lower bounds on the expected revenue when nested booking 
limits &i , . . . , b n are given. 



1 The Network Revenue Management Problem 

Consider the following planning situation: 

• Multiple resources are used to produce a variety of products, so that the 
same unit of resource may yield a different revenue. 

• The capacity of these resources is fixed, so that it is (practically) impos- 
sible to adjust capacity according to demand. 

• Demand is likely to exceed available capacity, so that some requests have 
to be rejected. 

Under these circumstances, rules to decide which requests should be rejected 
have to be developed. Obviously, a simple myopic acceptance/rejection policy 
like “first come, first serve” will lead to a suboptimal allocation of resources to 
demand in revenue terms. So the purpose of Network Revenue Management 
(NRM) methods is to divide resource capacities among products in a way 
that maximizes revenue. A common approach to control capacity usage is to 
define so called “booking limits” bj for each product j = 1 , . . . , n so that at 
most bj requests will be accepted for product j. 

For a more detailed description of the NRM problem and an extensive 
literature overview the reader is referred to the surveying papers by Klein [6] , 
McGill and van Ryzin [7], Tscheulin and Lindenmeier [10], and Weatherford 
and Bodily [11]. 

2 Problem Setting 

2.1 Notation 

In general, we can state a NRM Problem as follows: We are given m > 1 
resources with fixed capacities Ri > 0, i = 1, . . . , m. The cost to supply these 
capacities is sunk, and thus not relevant to our decisions. 
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In the planning horizon, we can use the resources to produce n products. 
The production coefficient of product j = 1 , . . . , n with respect to resource i is 
given by E [0, Ri\. We assume that each product needs at least one resource 
and that each resource is used by at least two products. The sale of a unit 
of product j yields a constant revenue (or profit margin) of Vj >0. Demand 
for product j is uncertain and denoted by the random variable Dj E No, and 
P (Dj = k) and P (Dj > k) are the probabilities that demand for product j 
is exactly k or at least k E No, respectively. 

To control usage of the scarce resource capacities, we enforce booking 
limits bj for each product j, i. e. we will at most sell bj units of product j. It 
is obviously reasonable to require 

bj E {0,...,6,} where bj — min{ [Ri/r^} | i = 1, . . . , m, > 0} (1) 

Using booking limits b = (b ±, . . . , b n ) over the planning horizon yields a total 
revenue of V (b) (a random variable). We want to set the limits bj so that 
the expected revenue E[V (b)\ is maximized. 

2.2 Nested Capacity Control 

Two different interpretations for the booking limits bj have been proposed: 
On the one hand, the booking limits bj may be used to partition the available 
capacity, i. e. 

n 

Y,bjrij<Ri z = l,...,ra (2) 

3 = 1 

holds and bjTij units of each resource i = 1 , . . . , m are exclusively reserved 
for product j = 1, . . . ,n. This capacity control strategy is quite inflexible, 
because the (bj + l)-th request for product j will always be rejected even 
if there is plenty of capacity remaining. To avoid this disadvantage, contin- 
gents of capacity should be nested among products: A nesting order, i. e. 
a permutation 7 r of {1 , . . . ,n} is defined and each unit of capacity that is 
available to product 7r (j) is also available to all products tt (j — 1 ) , . . . , tt (1). 
Consequently, we require 

^7r(j) ^ ^7r(j+l) J ~ • • • ? ^ I (3) 

for nested booking limits bj. The values 

PttU) = bir(j) ~ ^7z(j- 1-1) 3 ~ • • • 5 — 1 (4) 

are called nested protection levels. At any time, Pn^ri^j) units of resource 
i = 1 , . . . , m are protected for product it (j) from products tt (j + 1 ) , . . . , tt (n) 
(Belobaba [1]). 

The increase in flexibility of the nested capacity control strategy comes 
at a cost: The availability of resources depends on the sequence of requests 
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and acceptance/rejection decisions made earlier. Therefore a dynamic model 
necessary to represent the situation; in particular, the expected value function 
E [V ( b )] has to be expressed as a recursion formula. Evaluating this formula 
by Dynamic Programming (DP) is possible, but impracticable except for 
small instances. 



2.3 Literature Review and Purpose of the Paper 

Numerous authors have developed dynamic models for NRM problems with 
nested capacity control. Unfortunately, an efficient method to compute the 
exact value of E [V (5)] for instances of moderate size has not been found yet. 
To overcome this issue, Bertsimas and Popescu [3] and Chen et al. [4] have 
proposed methods to approximate this function. Bertsimas and de Boer [2] 
estimate E [V (6)] by simulation. Furthermore, heuristics have been devel- 
oped, the so called bid price method being the most successful (Cooper [5], 
Simpson [8], Talluri and van Ryzin [9]). 

Both to approximate the expected value function and to evaluate the per- 
formance of heuristics bounds on E [V (5)] would be helpful. To the author’s 
knowledge, this topic has not received much attention yet, so this paper de- 
rives upper and lower bounds on E [V (6)] for a given vector of booking limits 
b. 

3 Deriving Upper and Lower Bounds on E [V (6)] 

3.1 Deriving a Formula for E [V (6)] 

Let d = (di, . . . , d n ) be a realization of demand, i. e. the event Dj = dj,j = 
1, . . . , n has occurred. The probability of that event is 

n 

P(d) = l[P(D j = d j ) (5) 

3 = 1 

Denote the set of all demand realizations with positive probability by 

D = {d=(d 1 ,...,d n )|P(d)>0} (6) 

Finally, let the revenue obtained given demand d and booking limits b be 
given by Vb (d). Then, we can write 

E[V(b)] = Y / P(d)v b (d) (7) 

deD 

Since \D\ may be infinite, we replace D with 



Db — {c( G D\ dj ^ 



( 8 ) 
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Clearly, \Db\ is finite. Define 



p/ _ {Dj — dj) dj G {0, . . • , b j 1} 
K i, ~\P(D J >b J ) d j = b j 

P'(d)^f[P > (d j ) 

3 = 1 



( 9 ) 

( 10 ) 



Obviously, 

E[V{b)}= Y, P'(d)vb(d) (11) 

d(=.Db 

because if dj > 6j, the last dj — bj requests will denied anyway, no matter 
when they appear in the demand sequence. 

Equation (11) is not too helpful to compute E[V (6)] because a closed 
formula for Vb (d) is unknown. In the following, we will develop (mixed) integer 
programs that over- or underestimate Vb (d ) . 



3.2 Overestimating ( d ) 

Let booking limits b = (b ±, . . . , b n ) be given. Without loss of generality, we 
assume that 

bi>...>b n (12) 

so that we can omit 7 r. 

As mentioned before, demand materializes in some sequence, and for some 
requests resource capacity is allocated, others are rejected. Denote the num- 
ber of requests finally accepted for product j by a j G No, j = 1, . . . , n. We 
call the corresponding vector a = (ai,...,a n ) G No n an allocation, a has 
to satisfy the restrictions imposed by the resource capacity, by the booking 
limits and by the nested protection levels. Formally, the following constraints 
have to hold: 

n 

ajVij < Ri i = 1, . . . , m (13) 

3 = 1 

n n j— 1 

Y^akTik > 0 => y2 akrik - Ri - 5>r* * = l, — , /n, j = 2,...,n 

k=j k=j k= 1 

(14) 

dj € {0,...,bj} j = 1, . . . , n (15) 

Denote the set of all allocations a that satisfy restrictions (13), (14) and (15) 
by A b . 

Restriction (14) states that if requests were allocated for products j, . . . , n 
the allocated capacity should not be greater than the available capacity minus 
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the amount protected for the higher nesting products 1, . . . , j — 1. Since nested 
booking limits b are given here, we can easily compute nested protection levels 
Pi, . . . , Pn—i and determine a priori for which products l = j, . . . , n no request 
can be accepted anyway because Ri — Y^k^iPk r ik < 0 for some i. Therefore, 
we reduce the size of the given problem by setting 



n 



max 



j € {l,...,n} 



j~ 1 

< Ri 

k=i 



(16) 



Let d e D be any realization of demand. Define Uj = max {dj , bj } , j = 
1, . . . , n. If d G -4^, (d) can easily be computed: v b (d) = dj v j- Other- 

wise, we can use the following integer linear program to overestimate Vb (d): 



n 

ma x^ajVj (17) 

j = i 



s. t. 



n j — 1 

< -Ri - 

fe=l 

e {o, . . . , 'Uj} 

Define 





m,j = 1 


(18) 


3 = !,•••> 


n 


(19) 


(18), (19) 


de Ab 

otherwise 


(20) 



(d) = 



Sj=i dj y j 
max^^ =1 ajVj s. 



Obviously, (d) > (d). Note that (d) < ( b ) for all d e Db since 

more than bj requests will not be accepted anyway. 



3.3 Underestimating Vb ( d ) 

The mixed integer program (MIP) to underestimate Vb (d) is a bit more com- 
plex. It is apparently not sufficient to replace max by min in (17), because 
that will result in the trivial allocation dj = 0, j = 1, . . . , n. But the decision 
maker will of course allocate as much demand as possible, i. e. (s)he will not 
stop to accept requests from any demand sequence unless 

• there is no more demand. 

• the booking limit is reached. 

• the capacity is exhausted. 
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In the following MIP, we use a binary indicator Xj G {0, 1} = 1, . . . , n 

for the first two cases, and analogously an indicator Xij G {0, 1} for the latter: 



n 

min Y^ a j v j (21) 

3 = 1 



s. t. 



j — 1 n 

^ ^ Pk^ik d - ^ < Fti 

k = 1 k—j 

Pj > a j 

Pj > Pi 

Pj < tfjPj + (i - m 
p' - aj < qjM 

j - 1 n 

y"\p'k r ik + akrik - X% i ( R i+ £ - r ij) 

k= 1 k=j 

CL j X j W j 

m 

X 3 + X] - 1 

i=l 

Tij >0 

^ {0? •••»%*} 
p;>0 
Qj € {0, 1} 

Xij € {0, 1} 

Xj G {0, 1} 



i = 1, . . .,Tn,j = 1, . . . ,n (22) 

j = l,...,n-l (23) 

i = l,...,n-l (24) 

j = l,...,n— 1 (25) 

i = 1 (26) 



i = 1 = l,...,n,rij>0 



(27) 

j = 1, . . . ,n (28) 

j = 1, . . . ,n (29) 

j = 1, . . . ,n (30) 

j = 1, . . . ,n — 1 (31) 

j — 1, . . . ,n — 1 (32) 

i = = l,...,n,rij >0 (33) 

j = 1, . . . ,n (34) 



ai,...,a n represents the allocation whose revenue is minimized by (21). 
Pp Qj-> x ij 3 x j are additional decision variables with the domains given by (31) 
to (34). M is a “large” and £ is a “small” constant; precise bounds will be 
given in the following. 

(23) to (26) define that p'- = max {dj,pj} ,j = l,...,n — 1: Prom (23) 
and (24), we have p'- > max {dj,pj} = 1, . . . , n — 1. In addition, from (25) 
and (26) we have: 



qj = l => pj = pj A p f j - dj < M 
qj =0 => p'j = cij A p f j < M 



(35) 

(36) 
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where the rightmost inequalities will hold if M is “large enough” . Since 

p'j - aj <p'j = max {aj,pj} <bj, j = l,...,n-l (37) 

we can set: 

M = max {bj} (38) 

j=l,...,n— 1 

The variables Xj , Xij are used to formulate linear restrictions that repre- 
sent the stopping conditions described verbally above. Xj indicates if product 
j has exhausted its booking limit or demand (i. e. dj has reached the up- 
per bound dj or bj ), x^j indicates if resource i is exhausted with respect to 
product j. Formally: 

Xj — 1 => dj = Uj 

j— 1 n 

Xij = 1 => ^ma x{ a k ,p k }r ik + Yl akr ik > Ri- nj 
k= 1 k=j 

The first term on the left hand side of (40) represents capacity on resource i 
that is either used by or protected for products 1, . . . , j — 1. This inequality is 
linearized by(27).£>0 should be sufficiently small to capture that “>” was 
meant where “>” was written, e < 10“( fc+1 ) is a good choice, where k is the 
maximum number of decimal places of every r^-, i = 1 ,m,j = 1, . . . , n. 
Like before, define 



(39) 

(40) 



v b ( d ) = 



£j=i dj v j 

min Y^j = l a i v i s - (22) to (34) 



de Ab 

otherwise 



(41) 



3.4 Deriving Upper and Lower Bounds on E [V (6)] 

Over- and underestimating Vb{d) in (11) by ( d ) and v£ (d), respectively, 

leads the following lower and upper bound LB and UB, respectively: 

LB= Y,P'(d)Vbid) (42) 

d€zDb 

UB= P '( d )4(d) (43) 

d(zDb 

As these bounds on E [ V (6)] are finite sums, they can easily be computed 
if \Db\ is small. Unfortunately, \Db\ grows exponentially with n. Therefore it 
may be useful to choose a “small” subset D' C D and compute the following 
bounds instead: 

LB ' = E p> ( d ) v b ( d ) < LB (44) 

dED' 

UB> = E p ' ( rf ) < W+fl-E^ (<*) ) < w ^ UB ( 45 ) 

deD' \ deD' / 
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Abstract. The UMTS radio network planning problem poses the challenge of de- 
signing a cost-effective network that provides users with sufficient coverage and 
capacity. We describe an optimisation model for this problem that is based on 
comprehensive planning data of the EU project Momentum. We present heuristic 
mathematical methods for this realistic model, including computational results. 



1 Introduction 



Third generation (3G) telecommunication networks based on UMTS tech- 
nology are currently being deployed across Europe. Network operators face 
planning challenges, for which experiences from 2G GSM barely carry over. 
The EU-funded project Momentum developed models and simulation meth- 
ods for UMTS radio network design. Among others, we devised network op- 
timisation methods that are based on a very detailed mathematical model. 

Momentum constitutes, of course, not the only effort to advance meth- 
ods for UMTS radio network planning. In [1-3] several optimisation models 
are suggested and heuristics methods such as tabu search or greedy are used 
to solve them. Integer programming methods for planning are shown in [12], 
power control and capacity issues are treated in [4,11]. Many technical as- 
pects of UMTS networks and some practice-driven optimisation and tuning 
rules are given in [10]. Optimisation of certain network aspects without site 
selection is treated in [9]. 

Within this article, we focus on heuristic algorithms to solve the optimi- 
sation task. Methods based directly on the mathematical mixed integer pro- 
gramming model presented in [5,8] will be presented in the future. The prelim- 
inary computational results obtained within Momentum are very promising. 



* This work is a result of the European Project Momentum, IST-2000-28088 

** Supported by the DFG research center “Mathematics for key technologies” (FZT 
86) in Berlin. 
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2 Optimisation Approach 

Our optimisation approach is snapshot based. A snapshot is a set of users that 
want to use the network at the same time. We consider several snapshots at 
once and try to find a network that performs well for these snapshots and is 
cost-effective at the same time. Snapshots are typically drawn according to 
service-specific spatial traffic load distributions. 



2.1 Optimisation Model 



The following decisions have to be made for planning a network: 

Site Selection. From a set S of potential sites (roughly equivalent to roof 
tops where antenna masts could be placed), a subset of sites to be opened 
has to be chosen. 

Installation Selection. At each opened site various installations (antenna 
configurations) can be employed at different antenna locations. From the 
set X of all possible installations a subset has to be selected. The number 
of antennas per site is limited; three- sectorized sites are typical. 

Mobile Assignment. For each of the users, represented by the set A4 of 
mobiles that is possibly distributed over several snapshots, we have to 
decide which installation serves which mobile device. This is in practice 
often done on a best-server basis: each mobile is served by the installation 
whose signal is strongest at the mobile’s location. 

Power Assignment. Once the users are attached to installations, a feasible 
combination of power values has to be found. This includes transmission 
powers in uplink and downlink as well as the cells’ pilot powers. 

This is formulated as a MIP in [5,8], with binary variables corresponding to 
the first three decisions and fractional power variables p. 

The coverage and capacity requirements are reflected in so-called CIR 
inequalities (Carrier-to-Interference-Ratio) that have to hold for each user. 
These inequalities at the core of our optimisation model follow the pattern: 



Received Signal 
Interfering Signals 4- Noise 



> Threshold 



Using the notation from Table 1, the CIR inequality for the uplink reads: 



Tmj Prn 






T T T 

lrnj a mPm 



>A 



(la) 



The CIR inequality for the downlink is somewhat more complicated, since 
code orthogonality has to be considered for signals from the same cell: 



IjmPjm 



7 Jrn ( X - w rn) ( Pj - aLpjm ) + 7 f m Pi + Pm 



> 



(ib) 
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noise at mobile m 

uplink/downlink activity factor of mobile m 

orthogonality factor for mobile m 

uplink/downlink CIR target for mobile m 

attenuation factors between mobile m and installation j 

uplink transmit power from mobile m 

downlink transmit power from installation i to mobile m 

Total received uplink power at installation j (in the snapshot) 

Total downlink power emitted by installation j (in the snapshot) 

Table 1. Notations in CIR inequalities 



2.2 Planning Data 

Input data for our optimisation model is derived from the planning scenarios 
developed within the EU project Momentum. The full contents of these 
scenarios are described in [7] , several scenarios of them are publicly available 
at [13]. The scenarios contain detailed data on aspects relevant to UMTS 
radio network planning. The data can be classified as follows: 

Radio and Environment. All aspects of the “outside” world. This includes 
radio propagation, UMTS radio bearers, information on the terrain (such 
as height or clutter data), and background noise. 

Infrastructure. All aspects that are to some extent under the control of 
the network operator. This includes base station hardware, antennas, 
potential sites and antenna locations, and radio resource management. 
User Demand. All aspects related to users, such as offered services (e. g., 
video telephony, media streaming), user mobility, usage specifics, and 
traffic data. 

The potential sites and installations for the planning scenario “The Hague” 
are shown in Fig. 1(a), the average user demand is illustrated in Fig. 1(b). 
Darker areas indicate higher traffic load here, the users in the snapshots are 
generated according to this distribution together with additional information 
on the used services, equipment, and mobility. The actual parameters for the 
optimisation model [8] and the CIR inequalities (1), in particular, are derived 
from the information in the planning scenarios. Table 2 gives an overview. 



2.3 Preprocessing: Coverage and Capacity Analysis 

Before an automatic planning process can be employed, the input data is 
analysed in order to detect coverage and capacity shortages. The coverage- 
oriented analysis is based on propagation path loss predictions for all available 
sites and their antenna locations. Capacity shortages are harder to detect. We 
use a heuristic, which is based on a tentative network design using all available 
sites. Employing methods similar to the ones described in [4,14], the average 
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(a) Potential sites and antenna (b) Traffic distribution 

configurations (installations) 

Fig. 1 . Example of planning scenario (The Hague) 



Planning Scenario Parameter 



> 

Equipment loss, Connection loss 
Propagation loss, Antenna gain , 
Usage loss (e. g. body) J 


| Signal attenuation 7^,7)™ 


BLER requirements 

User speed , 

Radio bearer J 


| CIR targets 


User equipment, User mobility ) 
Radio bearer J 


> Activity factors 0:^,0^ 


Clutter type 1 

Channel model J 


► Orthogonality 



Table 2. Derivation of parameters from the data scenarios 



up- and downlink load per cell of this tentative network can be computed 
efficiently. If the traffic load is too high for the potential infrastructure in some 
regions, these can be localised as overloaded cells in the tentative network. 
Notice that this approach merely provides lower bounds on the achievable 
network up- and downlink capacity. Methods for estimating an upper bound 
on the network capacity are under development. 

3 Heuristic Planning Methods 

It turned out that solving mixed-integer program as described in its main 
components in Section 2.1 exactly (using for example Cplex 8.1) takes sig- 
nificant time and computing resources, even for moderate sized scenarios. 

Therefore, we developed various heuristic algorithms that aim at obtain- 
ing good (not necessarily optimal) solutions within reasonable running times. 
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The explanation of all these methods, including greedy-type heuristics, tabu 
search, simulated annealing, and evolution algorithms, is beyond the scope 
of this document. We restrict ourselves to the most successful one, the “Set- 
Covering Heuristic”. The interested reader may refer to [5,6] for the descrip- 
tion of the other methods. 



3,1 Set-Covering Heuristic 

The idea of the Set- Covering Heuristic is to find for each installation i eX a 
set Mi of mobiles that this installation can “cover” (we will explain this in 
more detail below). We assign a cost c* to each of these sets Mi and then find 
a set J = {ji, • • . , jk} Q {1, . . . , \X\} of indices such that each mobile m £ M 
is covered by at least one M^j £ J and for which the cost cj = YljeJ c 3 1S 
minimal. Each index in J corresponds to an installation, and we will simply 
select the installations that are given by J. 

In order to compute the set Mi for a given installation i £ X we proceed 
as follows: First of all, we ignore all other installations j £ X, j ^ i, that is, 
we assume they are not selected. We then consider each mobile m £ A4 and 
determine its distance d m ^ to installation i. We define this distance to be 
dm,i = 1/(7 mi + 7 / m ) if both attenuation values are non-zero (attenuation is 
set to zero if the corresponding pathloss exceeds a certain threshold). If the 
up- or downlink attenuation between mobile m and installation i is zero, this 
mobile can never be served by installation i. We then set d m ^ = oo. 

Let M denote the set of mobiles for which d m ,i < oo. We initially set 
Mi — 0 and sort the mobiles in M by non-decreasing values of d m According 
to this list we check for each mobile m, whether installation i can serve all mo- 
biles in Mi U {m} simultaneously. In the positive case we set Mi = Mi U {m}. 
The feasibility check is based on a Power Assignment Heuristic, which basi- 
cally solves two systems of linear equations that arise when inequalities (la) 
and (lb) are replaced with equations, see [5,6] for details. 

The Power Assignment Heuristic does not only check whether installation 
i can serve all mobiles in Mi U {m} but also finds minimal transmission 
powers for each mobile/installation connection in the positive case. These 
transmission powers are used to compute a score c* for the resulting set Mf. 

(k = ^2 + Ci 

m€Mi m£Mi 



where the terms p T and p ^ denote up- and downlink transmission powers 
as returned by the Power Assignment Heuristic and Ci is the cost that is 
associated with installing installation i. The factors and are used to 
weight the transmission powers in the cost for set Mi. From iterating over 
the list of mobiles with d m ^ < oo we obtain a set Mi together with a score 
(or “cost”) Ci as desired; see Algorithm 1. 
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Algorithm 1 Covering a set of mobiles with a given installation. 

Input: Installation i G X and mobiles Ad C A4 that i may potentially cover. 

1. Determine the mobile/installation distance d m ^ for each mobile in A4. 

2. Sort A4 by non- decreasing distance to i. Denote result by M sor ted- 

3. Set Ad return ~ 0 and C r etu rn = C%. 

4 . For each mobile m € M sor ted do 

(a) Set Ad' = Ad return U {m}. 

(b) Use Power Assignment Heuristic to check whether installation i can 
serve all mobiles in Ad'. 

(c) If so, set Adretum — AH' and update c re t ur n according to equation (2). 

5. Return Ad return and Creturn • 

Given the sets Adi and associated costs Ci for each installation, we define 
a set-covering problem. Let A € Rl-^M^ denote the incidence matrix of A4 
and the Adi (he., = 1 if and only if mobile i is in Adj) and introduce 

binary variables xj,j — 1, . . . , \1\ that are set to one if set Adj is selected and 
to zero otherwise. The set-covering problem then reads as follows: 

min {!>, | Ax > l,i£ {0,l} |x| j (3) 

iGX 

Notice that in the above description we implicitly assume that IJ^gx Mi = A4. 
If this is not the case we simply replace A4 by \J ieI Adi. 

As stated earlier, each set Adi is in direct correspondence with an instal- 
lation i G X. Thus, given an optimal solution x € {0, 1}^ to (3) we simply 
select all installations i E X for which Xi = 1 and install them. 

The Set-Covering algorithm as described above has three problems: 

• Model (3) is too simplistic: it does, for example, not take into account 
that installations are hosted at sites. Opening such a site requires a cer- 
tain amount of money (typically much more than the cost for a single 
antenna) and for each site there are minimum and maximum numbers of 
installations that can be simultaneously installed. 

• Due to the fact that we ignore all other installation while computing the 
set Adi for installation z, we also ignore potential interference from these 
installations. The sets M* tend to overestimate the coverage and capacity 
of the installations. 

• The set-covering problem as defined in (3) may not have a feasible so- 
lution. This can especially happen if traffic is high and the number of 
installations that are available per site is limited. 

All three problems can be resolved: In the first case, the additional con- 
straints related to sites can easily be added to (3). In the second case, we 
shrink the sets Adi at the end of Algorithm 1 using a “shrinkage factor” 
/shrink- Or we impose some heuristically determined interference via a “load 
factor” /i oac i and require that the installation may not use more than that 
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percentage of its maximum load during the algorithm. We distinguish two 
cases if (3) is infeasible. In case /shrink and /i oa d equal one we declare the 
input infeasible (which is true up to the assumption that we have performed 
an optimal mobile assignment). In case at least one of these factors is less 
than one we modify the factors and iterate. 

3.2 Results 

Using the Set-Covering Heuristic we are able to compute good solutions to 
large-scale real world instances. We illustrate one such result for the “The 
Hague” scenario mentioned in Section 2. The instance contains 76 poten- 
tial sites, 912 potential installations, and 10,800 mobiles partitioned into 20 
snapshots (approximately 540 mobiles per snapshot). For this instance we 
obtained the best result using a combination of the “heuristic interference” 
and “heuristic shrinking” strategies by setting /shrink = 0.7 and /i oa d = 0.6. 

With these modifications the Set-Covering heuristic took 66 minutes on 
a 1 GHz Intel Pentium-III processor with 2 GB RAM to find the final in- 
stallation selection. Fig. 2 depicts the solution. Fig. 2(a) shows the selected 
installations/ antennas; the load in the network is illustrated for uplink and 
downlink in Fig. 2(b) and Fig. 2(c) (the light areas denote a load of about 
25-30%, the darker areas have less load). Our result was evaluated using ad- 
vanced static network simulation methods developed within the Momentum 
project [14]. The methods reported at most 3% missed traffic. 






(a) Selected antennas 



(b) Uplink load 



(c) Downlink load 



Fig. 2. Heuristic planning solution 



4 Conclusion 

We presented an optimisation problem of planning cost-effective UMTS radio 
networks. The model we use reflects many aspects of reality that are essential 
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for planning UMTS networks. To our knowledge, this is the most detailed and 
comprehensive planning model in literature. Based on this model, we have 
described some heuristic network planning methods that work well in practice 
and lead to good results. 

References 

1. E. Amaldi, A. Capone, F. Malucelli. Planning UMTS base station location: 
Optimization models with power control and algorithms. IEEE Transactions 
on Wireless Communications , 2002. 

2. E. Amaldi, A. Capone, F. Malucelli, F. Signori. UMTS radio planning: Op- 
timizing base station configuration. In Proceedings of IEEE VTC Fall 2002 , 
volume 2, pp. 768-772, 2002. 

3. E. Amaldi, A. Capone, F. Malucelli, F. Signori. Optimizing base station lo- 
cation and configuration in UMTS networks. In Proceedings of INOC 2003 , 
pp. 13-18, 2003. 

4. D. Catrein, L. Imhof, R. Mathar. Power control, capacity, and duality of up- 
and downlink in cellular CDMA systems. Tech. Rep., RWTH Aachen, 2003. 

5. A. Eisenblätter, E. R. Fledderus, A. Fügenschuh, H.-F. Geerdes, B. Heideck, 
D. Junglas, T. Koch, T. Kürner, A. Martin. Mathematical methods for au- 
tomatic optimisation of UMTS radio networks. Tech. Rep. IST-2000-28088- 
MOMENTUM-D43-PUB, IST-2000-28088 MOMENTUM, 2003. 

6. A. Eisenblätter, H.-F. Geerdes, D. Junglas, T. Koch, T. Kürner, A. Martin. 
Final report on automatic planning and optimisation. Tech. Rep. IST-2000- 
28088-MOMENTUM-D46-PUB, IST-2000-28088 MOMENTUM, 2003. 

7. A. Eisenblätter, H.-F. Geerdes, T. Koch, U. Türke. MOMENTUM public plan- 
ning scenarios and their XML format. Tech. Rep. TD(03) 167, COST 273, 
Prague, Czech Republic, Sep. 2003. 

8. A. Eisenblätter, T. Koch, A. Martin, T. Achterberg, A. Fügenschuh, A. Koster, 
O. Wegei, R. Wessäly. Modelling feasible network configurations for UMTS. 
In G. Anandalingam and S. Raghavan, editors, Telecommunications Network 
Design and Management Kluwer, 2002. 

9. A. Gerdenitsch, S. Jakl, M. Toeltsch, T. Neubauer. Intelligent algorithms for 
system capacity optimization of UMTS FDD networks. In Proc. IEEE 4th 
International Conference on 3G Mobile Communication Technology , pp. 222- 
226, London, June 2002. 

10. J. Laiho, A. Wacker, T. Novosad, editors. Radio Network Planning and Opti- 
mization for UMTS . John Wiley & Sons Ltd., 2001. 

11. K. Leibnitz. Analytical Modeling of Power Control and its Impact on Wideband 
CDMA Capacity and Planning. PhD thesis, University of Würzburg, Feb. 2003. 

12. R. Mathar and M. Schmeink. Optimal base station positioning and channel as- 
signment for 3G mobile networks by integer programming. Ann. of Operations 
Research , (107):225-236, 2001. 

13. Momentum Project. Models and simulations for network planning and control 
of UMTS, http://momentum.zib.de, 2001. IST-2000-28088 MOMENTUM. 

14. U. Türke, R. Perera, E. Lamers, T. Winter, C. Görg. An advanced approach 
for QoS analysis in UMTS radio network planning. In Proc. of the 18th Inter- 
national Teletraffic Congress , pp. 91-100. VDE, 2003. 




Distribution Planning Problem: A Survey 



Bilge Bilgen, Irem Ozkarahan 

Department of Industrial Engineering, Dokuz Eylul University, 35100, 
Izmir/TURKEY 



Abstract. In this paper we present a review for the distribution planning problem. We posi- 
tion the contribution in a framework that classifies the related research in terms of decision 
levels. These are strategic, tactical and operational levels. We also tabulate the reviewed re- 
search in terms of model types, model characteristics, solution procedures and the decision 
levels. 
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1 . Introduction 

With the increasing significance of distribution function within supply chain man- 
agement, distribution decisions become important. Distribution cost makes a sig- 
nificant contribution to total cost. For this reason, the design of distribution system 
is an important issue in many organizations. The distribution planning problem is 
a complex task, since it is composed of organizations linking a supplier to its vari- 
ous customer segments. It involves decisions related with location of warehouses, 
fleet management (vehicle routing considerations), and inventory related deci- 
sions. 

There are many survey papers related with the SCM area. Of all the previously 
published survey papers in SCM area, only [1] gives special emphasis on the dis- 
tribution planning problem. [1] reviews some of the significant work which has 
contributed to the solution of location problems of physical distribution manage- 
ment. [27] emphasize the importance of coordinated planning of procurement, pro- 
duction and distribution stages of SCM. [29] emphasize on the mixed integer pro- 
gramming (MIP) based strategic production and distribution models and global 
logistics. [7] review the production and distribution planning. [24] review the lit- 
erature on integrated analysis of production and distribution system that explicitly 
considers transportation system. 

In this paper we provide a literature survey of the distribution planning prob- 
lems. We also provide a broad classification scheme. While production planning 
problems is of a tactical nature, distribution planning problems is more operational 
characteristics. The sources used for our survey study consists of scientific jour- 
nals and textbooks. We exclude proceeding papers, master thesis, doctoral disser- 
tations, and working papers. The articles are all related to the distribution planning 
problem. The keywords used are distribution planning, supply chain management. 
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The paper is organized as follows. In section 2, we review the literature in terms 
of relevant decision levels. In the last section we draw conclusions. 



2. Review of the Related Research 

We subdivide the field in terms of the relevant decision levels. The strategic level 
deals with the long-term decisions including DCs location. The tactical level deals 
with the medium term decisions including source-distribution allocation, customer 
allocation, plant capacity and distribution-client allocation. Operational level deals 
with the short term decisions, including the vehicle routing [3]. Table 1 presents a 
classification of the reviewed literature in a chronological order. 



2.1 Strategic Models 

[10] make an important contribution to the literature by presenting a new method 
for the solution of the problem addressed the optimal location of distribution 
centers (DCs). They present an algorithm based on the Benders’ decomposition 
for solving the multi-commodity distribution system design problem. The model 
comprises a number of plants, DCs and customer zones whose demand are known 
and fixed and that must be assigned to the DCs 

[25] have examined the effect of location/routing cost structures, potential 
number of depot sites and the spatial arrangement of customers on the perform- 
ance of three alternative location routing heuristics. The research shows that the 
performance of alternative location routing procedures is affected by various key 
environmental factors. 

[8] makes an important contribution to the literature by presenting different 
types of distribution networks with up to three transport stages namely, central 
warehouses, regional warehouses, transshipment points and nonlinear transport 
costs derived from freight tariffs. A general multi product distribution planning 
model is presented. The applicability of the proposed model is demonstrated by 
the three case studies. 

[11] presents an optimization model that determines the structure of the distri- 
bution system. He develops a multi-period, facility location and material flow 
model. The main contribution of this model is the consideration of number of 
complicating constraints, such as moving units, a limited pool of transportation as- 
sets, and material flow requirements. 
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Table 1. Summary of the reviewed research 
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2.2 Tactical Models 

[19] develop a model for the analysis of the logistics operations at DowBrand Inc., 
that identifies a logistic cost savings opportunity of $1.5 million per year. The 
authors develop an optimization-based Decision Support System (DSS) for 
designing two echelon, multi-product distribution systems. It is a deterministic 
formulation that considers minimization of fixed cost for establishing central and 
regional DCs, and variable cost for serving customers. Within the constraints, the 
model considers demand limits, feasible system configuration constraints. 

[12] address the two-stage multi-commodity distribution planning problem. The 
network comprises a number of manufacturing plants, DCs and a number of 
customers. This problem is formulated as MIP and solved by branch and bound 
procedure. Later again, [13] study on the same problem by adding two 
complicating issues: consideration of single sourcing constraints and lot tracing. 

[2] develop a MILP for minimizing logistics cost at Netherlands Car BV. The 
model aims to determine the ordering dates and quantities of purchase parts, given 
constraints on demand, transportation, inventory levels and packaging. The au- 
thors reformulate the large scale model by reducing the number of decision vari- 
ables, the number of periods, the number of products so that it could be solved us- 
ing branch and bound method within a reasonable time. Main concentration is 
given to reducing the model complexity. 

[18] address the problem of optimization for the short term distribution plan- 
ning in an Indian electronics firm. They present a multi-period, minimum cost 
network flow model for each product item. The formulation addresses the specifi- 
cation of the quantities to be dispatched from each production centre to the various 
DCs in each week of the month. They also present a real world case study to illus- 
trate the implementation and actual use of the model. The unique feature of their 
model is that it can backlog the demand at any DC in any week to later in the 
month. A system has been developed which adapts a hierarchical planning strat- 
egy for decision making. 

[20] propose a multi-disciplinary system design framework. This framework 
enables flexibility to analyze a wide range of supply chain network design prob- 
lems. It provides a comprehensive DSS tool for distribution network planning. 
The main contribution of this paper is the verification the framework’s large-scale 
capability and potential application in industry. 

[23] develop an integrated methodology for planning and analysis of a petro- 
leum distribution. The aim of the paper is to focus on reconfiguration of an exist- 
ing supply chain network. A case study is presented to demonstrate the application 
of proposed methodology. Data envelopment analysis is used to analyze the cur- 
rent operations. Branch and bound procedure is used for selection of distribution 
facilities and allocation of resources to the facilities. This paper differs from the 
literature in terms of consideration of nonparametric component for performance 
data analysis within the developed methodology in addition to optimization based 
modeling component. 

[15] develops a MIP based model for the distribution network design problem. 
The objective is to minimize the total variable cost and the total fixed costs related 
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with opening warehouses. The decisions to be determined include: location of fa- 
cilities and specification of expected throughput levels for the facilities depending 
on their assigned distribution strategy. The distinguishing feature of this work is 
that, it demonstrates the large scale capability of the framework and verifies its po- 
tential benefits in the supply chain industry. 

[14] develop a MIP model for the multi-period inventory distribution problem. 
The formulation addresses the problem of determining vehicle schedules and 
delivery quantities for the retailers. The objective is the minimization of 
transportation cost and inventory holding cost at retailers. A solution procedure 
based on a lagrangean relaxation is presented. 

[22] addresses the supply network problem where resource inputs are con- 
strained to achieve performance goals for the redesigned distribution system. The 
author proposes simulated annealing (SA) based heuristic in which has two 
phases. After the best sets of DCs are selected open, the customer assignments and 
resource assignments are performed. This paper makes important contributions to 
the literature in terms of performing the SA heuristic and the setting of the unique 
problem structure. 

[6] present both the deterministic and stochastic models of strategic planning 
for logistic operations in oil industry. They implement stochastic programming so- 
lutions for a multi-period supply, transportation and distribution scheduling prob- 
lem under uncertainty in the product demand. Main concentration is only on the 
formulation and implementation of strategic and tactical level problems. The 
model is solved by the XPRESS suite of LP solvers. 

[17] propose a DSS for the distribution planning problem. This model differs 
from the literature by considering bicriteria model. Their objective involves mini- 
mization of delivery time versus maximization of volume delivered. The applica- 
bility is the proposed model is demonstrated by a case study for agricultural power 
fuels. 

[21] presents a marine inventory/routing problem. The objective is the minimiz- 
ing total cost considering both the shipping costs (fixed and variable) and the cost 
of violating the specified safety stock levels. The following decisions are deter- 
mined: how much to ship of each product from which origin to which destination, 
when and by which vessel. The major contribution of this work is in the determi- 
nation of the timing source and product composition of each shipment, while ac- 
counting for the product specific storage limitations at the origins and the destina- 
tions. 

[16] develop a multi-echelon distribution network design problem. The network 
consists of a central manufacturing plant site, multiple DCs and cross-docking 
sites, and a set of customer zones. The models are formulated as MIP model. SA 
methodology is used to tackle with this problem. It incorporates cross-docking in 
supply chain environment. 
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2.3 Operational Models 

[4] propose an optimization model consider a multi commodity, capacitated 
distribution planning model for two stages of distribution. They developed a 
combined distribution/routing model aiming to determine: i . the number and sizes 
of vehicles in the fleet, ii. the number, location and sizes of warehouses and Hi. the 
product mix at each warehouse, iv. plant and DC assignment. The problem is 
solved within an algorithm based on Benders’ decomposition. Computational 
experiments are done on randomly generated test problems. 

[28] studies on a complex multi-level production and distribution network op- 
timization problem. The problem is modeled as a MILP formulation by using 
fixed charge network flows supplemented by various constraints and variables. 
Decisions that need to be considered are: location of bottling plants and depots, 
the production levels at the refineries and the plants, the stock levels at the plants 
and the depots, the transportation volumes on each link of the distribution net- 
work, the number of trucks and drivers, the transportation shift systems and 
schedules, and the customer assignments. The problem is solved for various sce- 
narios. Projected savings can be achieved ranging 10% to 25% of the total actual 
distribution cost. The actual problem illustrates the applicability of this procedure. 

[5] develop a MILP model aiming to redesign the distribution structure for a 
large oil company. They decompose the problem into the components: depot loca- 
tion and client assignment, cyclical delivery scheduling, actual vehicle routing. 
These are solved sequentially. They develop a feedback mechanism to consider 
stage interrelations between the sub-problems. The total logistic savings are in the 
range of 5-6% per year. 

[26] presents a mathematical model for the design of a physical distribution 
system. The formulation addresses the number and locations of DCs, the fleet size 
and the vehicle routing problem. The cost of DC, vehicle purchase cost and trans- 
portation cost of physical distribution system are included in the objective func- 
tion. The constraints in the model are: vehicle capacity constraint, single sourcing 
of vehicles to customers, maximum number of depot locations established in the 
production and distribution system, route continuity constraint, assignment con- 
straints of customers to the locations. A solution procedure based on genetic algo- 
rithm is presented. Author also presents an experimental simulation study which 
investigates the effects of genetic parameters on system performance. 

[9] propose an optimization model for the production and distribution planning 
integrating components associated with capacity management, inventory alloca- 
tion and vehicle routing. Their model considers single plant, multi product, multi 
period logistic system in which different items are manufactured and delivered 
with limited available resources, for both the production system and the distribu- 
tion fleet. They develop a solution procedure based on lagrangian relaxation. Two 
solution procedures are presented: “decoupled” and “synchronized”. Both proce- 
dures are tested on various sizes of the problems so that the effectiveness of the 
proposed solution scheme can be displayed. Substantial advantage is provided by 
the synchronized approach. 
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[30] address the problem of trying to find transportation arrangements that 
combines both the composition of the vehicles as well as routing of these vehicles. 
The problem is formulated as MILP model and dynamic programming is em- 
ployed to find optimal transportation arrangement. The implementation of the new 
arrangement results in a decrease in total vehicle delivery cost by over 8%. The 
authors also present an experimental study to carry out various sensitivity analyses 
of the factors that critically affect the arrangements. 



4. Conclusion 

In this paper we review the distribution planning problem literature that deals with 

the strategic, tactical and operational levels. The review is also tabulated in terms 

of model type, model characteristics, solution procedures, and decisions levels. 

We draw the following conclusions: 

• Not much research has been done with stochastic models. 

• The vast majority of the publications found seem to include single objective 
function. The criterion most often used by the researchers is either minimiza- 
tion of costs and maximization of profits. 

• Most attention has been given to strategic and tactical issues. 

• New methodologies should be developed for coping with the distribution plan- 
ning problem. 
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Zusammenfassung Der vorliegende Beitrag präsentiert die Ergebnisse einer Ana- 
lyse zur Wahl eines geeigneten Artikelanordnungsmusters (Längs-, Quer-, Radialan- 
ordnung) bei gegebenen, in der Praxis häufig anzutreffenden Problemparametern. 
Die numerischen Ergebnisse zeigen für ein gegebenes Lagersystem, dass die Fest- 
platzlagerung einem chaotischen Lager vorzuziehen ist und dass durch die Wahl 
bestimmter Artikelanordnungsmuster in Abhängigkeit von der verwendeten Rou- 
tingstrategie Vorteile durch reduzierte Kommissionierwege erzielt werden können. 



1 Einführung 

Das Kommissionieren ist eine Lagerhausfunktion, welche die Entnahme von 
gelagerten Artikeln und ihr Zusammenführen gemäß vorgegebener Kunden- 
aufträge zum Gegenstand hat. Bei einem Mann-zur- Ware-Kommissionier- 
system sind die Artikel typischerweise in parallelen Gängen angeordnet, und 
das Kommissionierpersonal entnimmt die durch Kommissionieraufträge vor- 
gegebenen Waren auf einem Rundweg an den jeweiligen Stellplätzen. Grund- 
sätzlich lassen sich drei operative Entscheidungsfelder mit starken Interde- 
pendenzen identifizieren: (1) Artikelanordnung in Abhängigkeit von Arti- 
kelzugriffshäufigkeiten und Artikelvolumen (Storage), (2) Zusammenfassung 
mehrerer Kundenaufträge zu Kommissionieraufträgen (Batching) und (3) Be- 
stimmung eines Wegs, den der Kommissionierer durch das Lager nimmt, um 
die Artikel entsprechend des Kommissionier auft rags zu entnehmen (Routing) 

[i,n]. 

Dieser Beitrag berücksichtigt sämtliche Entscheidungsfelder und analy- 
siert die Eignung unterschiedlicher Artikelanordnungsmuster (Längs-, Quer-, 
Radialanordnung) bei verschieden ausgeprägten Artikelzugriffshäufigkeiten, 
variierter Gassenanzahl und verschiedenen Routingverfahren („Largest Gap“ 
und „S-Shape“). Als weitere Einflußgrößen werden das Fassungsvermögen 
des Kommissioniergeräts, der Auslastungsgrad des Lagers und die Größe der 
Kundenaufträge berücksichtigt. Ferner wird als Auftragsbildungsverfahren 
ein savingsbasiertes Batchingverfahren angewendet [3] . 
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Nach einer Beschreibung der Grundstruktur von Mann-zur-Ware-Kommis- 
sioniersystemen werden in Kapitel 2 die in der Analyse verwendeten Verfah- 
ren jeweils für die drei operativen Entscheidungsfelder erläutert, der Arti- 
kelanordnung, der Auftragsbildung und der Tourenplanung. Kapitel 3 be- 
schreibt den Aufbau der numerischen Experimente, deren Zielsetzungen und 
das Testdesign. Kapitel 4 beinhaltet die Ergebnisse und ihre Interpretation 
für die hier behandelten Routingverfahren „S-Shape“ und „Largest Gap“, 
sowie die Formulierung grober Entscheidungsregeln, die unter vergleichba- 
ren Voraussetzungen als Entscheidungsunterstützung herangezogen werden 
können. 



2 Problemstellung und Lösungsverfahren 

2.1 Grundstruktur von Mann-zur- Ware-Kommissioniersystemen 



Ein in der Praxis häufig anzutreffender Lagertyp besitzt typischerweise einen 
Blockaufbau und geht von einem rechteckig angelegten Entnahmebereich mit 
nur je einem Quergang an der Front- und Rückseite aus (Abb. 1). Der Zu- und 
Abgang vom Lager wird auch I/O-Punkt genannt und befindet sich in der 
unteren Ecke gegenüber dem Gang zwischen den ersten beiden Regalzeilen. 
Der Kommissionierer beginnt an dieser Stelle die Kommissioniertour und 
kehrt am Ende hierher zurück. 

Der eigentliche Kommissioniervorgang basiert auf einer Reihe von Kun- 
denaufträgen, die aus einzelnen Positionen bestehen. Eine Position bezeich- 
net einen Artikel (typ) sowie die vom Kunden gewünschte Menge. Es wird 
davon ausgegangen, dass die Menge der Kundenaufträge vorab bekannt ist 
(off-line Problem). Aus der Menge der Kundenaufträge werden Kommissio- 
nieraufträge (Pick-Listen) erstellt, die der Kommissionierer am Beginn einer 
Tour übernimmt und aus der die Menge der Artikel, deren Stellplätze und 
die Entnahmereihenfolge ersichtlich ist. Er benützt ein Kommissioniergerät 
bestimmter Größe um die entnommenen Artikel zu transportieren und meh- 
rere Stellplätze aufsuchen zu können, bevor er sich wieder zum I/O-Punkt 
begibt. Es wird ferner angenommen, dass die Gänge einerseits schmal genug 
sind, so dass der Kommissionierer links und rechts der Gänge die Waren oh- 
ne nennenswerte Positionsänderung entnehmen kann, andererseits auch breit 
genug sind, um ein Überholen oder Begegnen zuzulassen. 

Als Zielsetzung wird hier die Minimierung der Strecke gewählt, die zurück- 
gelegt werden muss, um eine gegebene Menge von Kundenaufträgen abzuar- 
beiten. Zur Erreichung dieser Zielsetzung kann die Planung und Ausführung 
der beschriebenen Abläufe in drei Entscheidungsfelder (Artikelanordnung, 
Auftragsbildung, Tourenplanung) gegliedert werden. 
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Abbildung!. Lagerlayout eines Standard-Kommissioniersystems 



2.2 Operative Entscheidungsfelder in der Kommissionierung und 
ihre Lösungsansätze 

Artikelanordnung (Storage) Beim Problem der Artikelanordnung sollen 
bei gegebenem Lager layout, gegebenen potenziellen Stellplätzen und gegebe- 
nen Kundenaufträgen eine Zuordnung der Artikel zu Stellplätzen gefunden 
werden, so dass die vom Kommissionierer zurückzulegende Strecke minimal 
ist. Strategien der Stellplatzzuordnung unterscheiden zwischen Festplatzla- 
gerung und chaotischer Artikelanordnung, wobei er stere auf die längerfristig 
gültige Bestimmung eines Stellplatzes für jeden Artikel abzielt, während die 
Problemstellung bei chaotischer Stellplatzvergabe die Auswahl eines freien 
Stellplatzes für einen zu lagernden Artikel beinhaltet. Das Problem der Arti- 
kelanordnung steht in engem Zusammenhang mit der Bildung von Kommis- 
sionieraufträgen und der Tourenplanung. Es wird davon ausgegangen, dass 
das Artikelanordnungsproblem mindestens NP-schwer ist [11]. Daher kom- 
men für reale Probleme vor allem Heuristiken in Betracht, welche die Artikel 
entsprechend ihrer Zugriffshäufigkeit zu Stellplätzen nach dem Kriterium der 
Entfernung vom I/O-Punkt zuordnen. In der Praxis wird die Orientierung 
an den Entfernungen durch die Verwendung von Anordnungsmustern über- 
lagert, die Zonen festgelegen, innerhalb derer die Artikel entsprechend einer 
Längs-, Quer- oder Radialanordnung gelagert werden [5,6]. 



Auftragsbildung (Batching) Strategien der Auftragsbildung haben die 
Umwandlung von Kundenaufträgen in Kommissionier aufträge zum Ziel. Zwi- 
schen Einzelauftragskommissionierung, bei der jeder Kundenauftrag einem 
Kommissionier auftrag entspricht, und der Auflösung von Kundenaufträgen 
zum Zweck der Kommissionierung mit anschließender Rücktransformation 
sind als Mischform die Aufspaltung eines Kundenauftrags und die Gruppie- 
rung mehrerer Kundenaufträge zu einzelnen Kommissioniertouren verbreitet. 
Die letztgenannte Form ist Gegenstand der vorliegenden Untersuchung. Das 
Problem der Auftragsbildung beinhaltet unter dem Aspekt der Wegemini- 
mierung die Aggregation vorliegender Kundenaufträge zu Kommissionierauf- 
trägen bei gegebener Stellplatzzuordnung, gegebenem Fassungsvermögen des 
Kommissioniergeräts und unter der Prämisse, dass einzelne Kundenaufträge 
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Abbildung2. Funktionsweise von „Largest Gap“ (o.) und „S-Shape“ (u.) 



ungeteilt in einem Kommissionierauftrag integriert werden sollen. Da dieser 
Problemtyp ebenfalls NP-schwer ist, kommt heuristischen Verfahren zentra- 
le Bedeutung zu [2,9]. Im Rahmen dieser Analyse wird das savingsbasierte 
EQUAL- Verfahren angewandt [3]. 



Tourenplanung (Routing) Strategien, die darauf abzielen, in welcher Rei- 
henfolge die Artikel an den einzelnen Standorten zu entnehmen sind, lassen 
sich in exakte und heuristische Verfahren einteilen. Exakte Verfahren bestim- 
men individuelle Touren, bei denen für jeden einzelnen Kommissionierauftrag 
die Entnahmereihenfolge bestimmt wird, während standardisierte Touren ei- 
nem Routingmuster folgen. Im Folgenden werden standardisierte Touren be- 
trachtet. Zwar ist Bestimmung einer Tour formal gesehen ein Rundreisepro- 
blem, das in seiner Ursprungsform NP-schwer ist, jedoch ist dieses spezi- 
elle Problem wegen der Stellplatzanordnung in Gängen mit polynomialen 
Aufwand lösbar [8]. Es ist festzustellen, dass keine Standardverfahren zur 
Verfügung stehen und sich Verfahren für individuelle Implementationen für 
Praktiker als zu schwierig darstellen. Daher haben einfache Verfahren wie 
das Largest Gap- Verfahren und das S-Shape- Verfahren besondere Verbrei- 
tung gefunden [4,10]. 

Abbildung 2 zeigt exemplarisch ein Standardlager mit 10 Gassen mit je 50 
Stellplätzen und einem Zugang links vorne. Dunkle Rechtecke repräsentieren 
Stellplätze, die aufgrund des Kommissionierauftrags besucht werden müssen. 
Das S-Shape- Verfahren (Abb. 2 unten) sieht charakteristischerweise vor, dass 
der Kommissionierer nicht wendet, sondern die Gasse, die er betreten hat, auf 
der gegenüberliegenden Seite verlässt, während das Largest Gap- Verfahren 
(Abb. 2 oben) Wendemanöver in fast allen Kommissioniergängen vorsieht [3]. 
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3 Numerische Experimente — Ziel und Test design 

Das Ziel der Analyse war die Evaluation der Anordnungsmuster, Längs-, 
Quer- und Radialanordnung, unter gleichzeitiger Berücksichtigung der Ein- 
flüsse aller Entscheidungsfelder (Artikelanordnung, Auftragsbildung und Tour- 
enplanung). Konkret wurden für das Auftragsbildungsver fahren EQUAL die 
Auswirkungen der Routingverfahren „S-Shape“ und „Largest Gap“ auf die 
Wahl der Artikelanordnung analysiert. Im Gegensatz zu Petersen und Schmen- 
ner [6], die die Zusammenhänge von Anordnungsmuster, Artikelanordnung 
und Routingverfahren analysieren, wird hier zusätzlich die Auftragsbildung 
berücksichtigt. Ausgehend von einem rechteckigen Standard-Mann-zur- Ware- 
Kommissioniersystem mit einer Lagerkapazität von 500 Stellplätzen werden 
drei unterschiedliche Layouts des Lagers analysiert, die durch die Anzahl der 
Gassen (5, 10 und 25 Gassen mit je 50, 25 bzw. 10 Artikel pro Seite in jeder 
Gasse) bestimmt werden. Zur Evaluation der Längs-, Quer- und Radialanord- 
nung wurde ein Problemgenerator implementiert, der über zwei unabhängige 
Zufallszahlenströme Kundenaufträge und Artikelanordnungen erzeugt. Aus 
der paarweisen Kombination von 10 verschiedenen Kundenauftragsbeständen 
und 10 verschiedenen Artikelanordnungen ergeben sich jeweils 100 Proble- 
minstanzen [7] . Folgende Einstellungen der Problemparameter wurden gete- 
stet: 

• Anzahl Stellplätze: 500 

• Größe der Kundenaufträge: U [5, .., 25] 

• Gassenanzahl: 5, 10 und 25 

• Artikelzugriffshäufigkeit: x s (60% der Zugriffe auf 20% der Artikel) 

• Lagerauslastung: 80%, 90% und 100% 

• Kapazität des Kommissioniergeräts: 30, 45, 60 und 75 Artikel 

• Größe der Auftragsbestände: 10, 25, 50 und 100 Kundenaufträge 

Für jedes der beiden Routingverfahren werden neun Ausprägungen der 
betrachteten Zielgröße (Länge der Kommissioniertour) angegeben, welche je- 
weils die Kombination einer von drei verschiedenen Lagerformen (5, 10 und 25 
Gassen) mit einer von drei verschiedenen Artikelanordnungsmuster (Längs-, 
Quer- und Radialanordnung) bewerten. Da jede dieser neun Ausprägungen 
jeweils eine Aggregation über drei verschiedene Auslastungsgrade des Lagers, 
vier verschiedene Kapazitäten des Kommissioniergeräts und vier verschiede- 
ne Größen von Auftragsbeständen darstellt, wurden je Routingverfahren da- 
her 43.200 Probleminstanzen bewertet; jede Ausprägung bedeutet also eine 
Aggregation über 4.800 Probleminstanzen. Als Messgröße dient die durch- 
schnittliche relative Verbesserung der Ergebnisse, die gegenüber chaotischer 
Artikelanordnung erreicht werden. 

4 Ergebnisse 

Die Ergebnisse der Simulationsuntersuchungen sind jeweils getrennt nach den 
beiden Routingverfahren „Largest Gap“ und „S-Shape“ (Abb. 3) dargestellt. 
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Abbildung3. Mittlere, relative Wegeinsparung durch Artikelanordnungsmuster 
gegenüber chaotischem Lager bei Verwendung von „Largest Gap“ (links) bzw. „S- 
Shape“ (rechts) als Routingverfahren 



Das relative Verbesserungspotenzial, das gegenüber chaotischer Stellplatzver- 
gabe im Mittel erzielt werden kann, wird durch die Säulenhöen visualisiert. 



4.1 Artikelanordnung bei Routingverfahren „Largest Gap“ 

Bei der Anwendung des Largest Gap- Verfahrens sind bei einem Lager mit 5 
Gassen fast 8% relative Einsparung bei Queranordnung gegenüber einer chao- 
tischen Stellplatzvergabe möglich. Der Vorteil von Largest Gap, das gänzliche 
Traversieren einer Gasse zu vermeiden, bringt in Kombination mit langen 
Gassen und einer Queranordnung ein etwas höheres Einsparungspotenzial 
als die Längsanordnung mit 6,3% und die Radialanordnung mit 7,1%. Bei 
10 Gassen zeigen alle drei Anordnungsmuster annähernd gleiches Verbesse- 
rungspotenzial von ungefähr 9% gegenüber chaotischem Lager. Bei 25 Gassen 
und gleichzeitig abnehmender Gassenlänge bieten querangeordnete Artikel 
nur noch eine Verbesserung von 5,7%, da der Kommissionierer gezwungen 
ist, jede Gasse vom vorderen Quergang aus zu betreten und deshalb jeweils 
ein Wendemanöver durchführt. Die Wegstrecke, die eventuell im Inneren der 
sehr kurzen Gasse eingespart werden kann, verliert im Verhältnis zum Wende- 
manöver an Bedeutung. Hingegen ermöglichen längs- und radialangeordnete 
Artikel auch hier jeweils Wegeinsparungen von etwas mehr als 10%. 



4.2 Artikelanordnung bei Routingverfahren „S-Shape“ 

Da das S-Shape- Verfahren vorsieht, jede Gasse, in der ein Artikel zu kommis- 
sionieren ist, zur Gänze zu durchlaufen, profitiert dieses Verfahren von der 
Längsanordnung mit über 12% Wegeinsparung besonders bei ungerader Gas- 
senanzahl, da die Wahrscheinlichkeit relativ hoch ist, dass in der letzten Gasse 
keine Artikel zu kommissionieren sind und somit das Betreten dieser letzten 
(ungeraden) Gasse und das damit verbundene Wendemanöver wegfällt. Bei 
10 Gassen führt der Wegfall des Kommissionierens in der letzten Gasse oft zu 
einem Wendemanöver, das einen Teil der Wegersparnis wieder egalisiert. Die 
Queranordnung erweist sich in Verbindung mit „S-Shape“ verglichen mit den 
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anderen Anordnungsmustern am wenigsten effektiv. Im Vergleich zu chaoti- 
scher Einlagerung kommt es zwar bei geringer Gassenanzahl zu einer Ein- 
sparung von immerhin fast 7%, weil die Artikel mit großer Zugriffshäufigkeit 
unmittelbar beim vorderen Quergang liegen und der Kommissionierer schon 
nach kurzer Strecke wenden kann. Im Gegensatz dazu ist bei zufälliger Stell- 
platzvergabe die Wahrscheinlichkeit höher, dass Artikel zu kommissionieren 
sind, die wesentlich weiter im Inneren der Gasse liegen. Bei fixer Anzahl der 
Stellplätze bedeutet eine höhere Gassenanzahl gleichzeitig eine entsprechend 
verringerte Gassentiefe. Bei 25 Gassen beträgt die Gassentiefe nur noch 10 
Stellplätze (statt 50 Stellplätzen bei 5 Gassen) und verringert somit das We- 
geinsparungspotenzial deutlich auf 1,5%. 



5 Schlussfolgerungen und Resümee 

Die vorliegende Arbeit analysiert die Vorteilhaftigkeit von Artikelanordnungs- 
mustern, nämlich der Längs-, Quer- und Radialanordnung, im Vergleich zu 
chaotischer Stellplatzvergabe an Hand eines exemplarischen Standard-Kom- 
missionierlagers. Numerische Ergebnisse mit unterschiedlichen Kundenauf- 
tragsstrukturen, Auslastungsgraden, und Kapazitäten zeigen unter Berück- 
sichtigung der Auftragsbildung das Verbesserungspotenzial gegenüber chao- 
tischer Einlagerung getrennt nach zwei in der Praxis weit verbreiteten Rou- 
tingverfahren, dem Largest Gap und dem S-Shape- Verfahren, dass Festplatz- 
lagerung einem chaotischen Lager prinzipiell vorzuziehen ist. Ferner machen 
sie deutlich, dass das Ausmaß der Vorteilhaftigkeit von unterschiedlichen An- 
ordnungsmustern bei einem Lagersystem des hier betrachteten Typs von dem 
angewendeten Routingverfahren abhängig ist. Bei Verwendung von „Largest 
Gap“ in eher schmalen Kommissionierläger mit wenigen, aber langen Gassen 
erweist sich die Queranordnung etwas vorteilhafter, während in breiten Kom- 
missionierläger mit vielen, aber kurzen Gassen die Längs- oder Radialanord- 
nung vorzuziehen ist. Ferner kann gezeigt werden, dass sich bei Verwendung 
von „S-Shape“ die Längsanordnung in allen untersuchten Lagerlayouts den 
anderen beiden Mustern gegenüber überlegen erweist, hingegen die Queran- 
ordnung den beiden anderen Anordnungsmustern deutlich unterlegen ist. 

Generell kann festgestellt werden, dass Anordnungsmuster zu Wegeinspa- 
rungen zwischen 6,3% und 12,7% führen, mit Ausnahme der Queranordnung 
bei „S-Shape“ und geringer Gassentiefe. Die Längs- und Radialanordnung 
scheinen robuster als die Queranordnung zu sein, da sie meist entweder glei- 
che oder bessere Ergebnisse als die Queranordnung liefern. 

Aus den vorliegenden Ergebnissen lassen sich als grobe Entscheidungsre- 
gel einige Aussagen formulieren: für ein Lagersystem des hier betrachteten 
Typs und unter Verwendung des Routingverfahrens „S-Shape“, kann durch 
Längs- oder Radialanordnung bei größerer Gassenanzahl durchschnittlich ei- 
ne Wegeinsparung von rund 9% bis 13% erzielt werden; eine Queranordnung 
nach Zugriffshäufigkeit klassifizierter Artikel hat kaum Einsparungspotenzi- 
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al. Erfolgt die Routenwahl hingegen nach dem Largest Gap- Verfahren, so ist 
nur bei wenigen, langen Gassen die Queranordnung vorzuziehen und lässt 
bei vergleichbarer Problemstellung eine Einsparung von rund 8% erwarten. 
Hingegen ist bei größerer Gassenanzahl der Längs- oder der Radialanord- 
nung der Vorzug zu geben und eine Wegersparnis ebenfalls in einer Größen- 
ordnung von 9% bis 10% zu erzielen. Da weitere Tests gezeigt haben, dass 
auch bei Verwendung des äußerst einfachen, in der Praxis weit verbreiteten 
Batchingverfahrens, First Come First Serve, im Durchschnitt Einsparungen 
erzielt werden können, die rund 2 Prozentpunkte unter den hier mit dem sa- 
vingsbasierten EQUAL gezeigten Ergebnissen liegen. Die Aussagen bezüglich 
Qualität und Vorteilhaftigkeit einzelner Anordnungsmuster im gegenseitigen 
Vergleich treffen daher bei First Come First Serve grundsätzlich ebenso zu 
wie bei Verwendung von EQUAL. 
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Abstract. We study a supply chain whose acting objects apply local control poli- 
cies. The determination of the optimal order quantity is done by discret Markov 
decision models. The existence of the bullwhip effect is verified analytically. While 
analyzing the reasons of the bullwhip effect, we focus on the lack of information 
exchange and the uncertainty in demand. We determine the potential for improve- 
ments within the supply chain by implementing an additional information system. 
The shared informations are used by the discret Markov decision models to calculate 
the modified order quantities on every level of the supply chain. 



1 Introduction 

Within supply chains the participating companies usually are managing their 
inventory independently from upstream or downstream companies. Locally 
oriented inventory policies and insufficient information exchange inevitably 
lead to sub-optimal performance for the whole supply chain. An advantage 
of a cooperative contractual relationship within a supply chain is to avoid 
inefficient inventory control policies, which result from a lack of co-operation 
due to uncertain future demand rates and inaccurate information. The com- 
panies can exploit this potential only if they are willing to coordinate their 
control policies with the other companies in the supply chain. Starting from 
an isolated company we introduce a storage control model, which will be 
used for the subsequent steps. The calculation of the optimal order quantity 
is done by discrete markovian decision models. In the next section of this 
paper we analyze the reasons of the bullwhip effect. We focus on the lack 
of information exchange in an environment with stochastic market demand. 
This leads to over-reactions in the calculations of the demand forecast in the 
companies with a great distance to the market. We can show mathematically, 
that under the assumption of stochastic market demands the variances of the 
orders of a participating company is bigger than the variances of the arriving 
demands. Thus the existence of the bullwhip effect within a multi-stage sup- 
ply chain is verified. The impact increases with the distance of the specific 
company from the market. We enhance the basic model of the supply chain 
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by an information exchange system in order to enhance the basis of informa- 
tion to calculate the order quantities. It can be shown that the value of the 
amplification of variances of the amount of orders is decreased on every stage 
of the supply chain. This effect is more distinct on stages of the supply chain 
with a big distance from the market. 



2 Storage Control Model 

2.1 Modelling of a Storage System as a Stochastic Dynamic 
Decision Problem 

We analyze a storage system with a periodic registration of the inventory. The 
planning horizon T = { 1 , 2 , . ..,oo} is asumed to be infinite and discrete. 
The state space is indicated by S = {— oo, . . . , 1, 2, 3, . . . , oo}, where s n G 
S specifies the system inventory immediately before an order. The system 
inventory is composed by the net inventory of the storage and the inventory of 
the supplier. Immediately after the stock-check one has to select the amount 
of orders. Considering the modelling as a markov decision problem it is not 
reasonable to use the amount of orders as a decision variable but the system 
inventory after ordering. Hence there is an activity space A n (s n ) = {a n : 
Sn < an < oo} = { s n , s n 4- 1, . . . , oo}, with a n G A n (s n ) declares the system 
inventory immediately after ordering. Considering orders not to be negative, 
the activity space is restricted of values greater than the system inventory 
before ordering. For the selected amount of orders z n in period n results 
%n ~ tin S n . 

The demand during period n is declared by a discrete random variable D n 
with P(D n = x) > 0, 0 P(D n = x) = 1, F(a) = £" =0 P(D n = x). Here 

F(a) indicates the distribution function of D n . The function p n {s n + 1 | s n ,a n ) 
specifies the transition probability to state s n +i G S n +i. Because the chosen 
activity a n is defined as the system inventory after ordering, the transition 
function results to p{s n + 1 | s n , a n ) = p(s n + 1 | a n ). This is the probability for 
s n +i is independent from s n and only depends on a n . 

At the end of the period there is a positive or negative net inventory 
which is used for the evaluation of costs. The stage costs are fc(s n ,a n ) = 
c{a n — s n ) 4- l(a n ,D n ),a n G A(s n ),s n G S where c(a n — s n ) declares the 
linear ordering unit costs and Z(a n , D n ) the storage respectively the shortfall 
costs in a period with demand D n . Hence the function Z(a n , D n ) also depends 
on the shortfall costs 7r, the storage costs h and the delay of delivery v. 



2.2 Determination of Optimal System Inventory 

To determine the activity at the decision times we have to find a decision 
rule which assignes for every state s n G S n in every instant n G T one unique 
activity a n G A n (s n ). Such a function f n : S n A n with f n (s n ) G A n (s n ), 




57 



s n £ Sn is called decision rule for period n. The sequence of decision rules 
d n = (/i, / 2 ? • • • , /jv) £ ^4 at is called N stage strategy, where An describes 
the quantity of N stage strategies. 

For a stationary model with infinite stages, which is formaly described by 
M = [5, {-A(s), s G 5 n },p, fc, ß\ n e[ i,...,oo] with finite state respectively activity 
spaces and discounting coefficient ß G [0; 1) applies [1]: 

1. The function Vß(s) is unique limited solution of the system 



Vß{s) = min < k(s, a) + ß V] p„(s'|s; a)v ß (s') > , s£ S (1) 

aeA„ (s) ^ J 

2. There is a stationary optimal strategy d * = (/*, ...,/*) G A , whose de- 
cision rules /* choose for every s G S an activity so, that the minimum of 
the right hand side of the system (1), the Bellman optimization equations 
[2] is realized. 

For the solution of the decision problem the system (1) has a major impor- 
tance. The problem of finding decision rules which are minimizing costs is 
that when choosing the activity at the beginning of a certain stage the future 
of the process has to be considered. It would be easier to find a decision rule 
which minimizes the costs only for a given stage. Such a strategy is called my- 
optic [1]. In [3] the sufficient requirements for the existance of such a strategy 
are formulated. Hence there is a stationary strategy d* — (/*, ...,/*) with 



a = f(s) 



a* for s < a* 
s for s > a* ’ 



( 2 ) 



where a* declares the optimal system inventory. The system should be filled 
according to this at the beginning of a period. 



2.3 Backorder- Case, Model with Delay of Delivery 

In the backorder-case a not satisfied demand is transfered into the next pe- 
riod. The arising surplus will not be satisfied until the products are available 
at a later time instant. Considering the delay of delivery for every order there 
is a deterministic time of delivery of v periods. Therefore the arrival time of 
an order which was placed at the time n is n 4- v. The function of the storage 
costs in period n is 



n-\- v 

li&ni ^ ^ Di) 

i=n 



h (a n - Lilt A) ß v for A 

* far A - a n ) ß? for a n < A 



( 3 ) 



For any period n the expected costs are 

E(k(a,s)) = cv{a- s)+ ß v hY? z=0 p{Y%=n D i = z){a~ z )+ 
ß u K ET = a+ 1 *>(£?=; A = z)(z- a) 



(4) 
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Now we can determine the stage costs. The minimum is calculated by ex- 
amination of the equation a* = F~^ [3]. Here F v +\ is the 

v + 1-fold convolution of the known distribution function of the demand. 



2.4 Order Policies for Independent and Non Identically 
Distributed Demand, Backorder- Case 

In the following section we develop optimal order policies for independent 
and non identically distributed demand. Here we assume stationary costs, 
i.e. c n = c, 7r n = 7T, h n = h for all n £ T. 

D n declares the time series of the demand whose elements are independent 
but not necessarily identically distributed. It is however assumed that the 
types of distributions for all F n are identical and known. We use the normal 
distribution, but the resulting optimal system inventory can also be used for 
different distribution types. 

As the demand is not identically distributed over the periods the v + 1- 
fold convolution is not constant over the planning horizon and therefore the 
optimal system inventory could change. Now we have one out of n dependent 
distributions whose average value is fi ge f = d n -f . . . 4- d n +v and the variance 

is a gef = a l + • • • + a l+v- 

Under the assumptions that the company does not know the parameters 
d n , . . . , d n+I/ and cr^, . . . , cr^ +zy at the time instant n, it has to estimate them 
for the calculation of the optimal system inventory. For the determination 
of an ordering policy it is assumed that the turnovers stays constant. For 
the prediction of the totalized average values during the delay of demand 
we have therefore Y^l=n ^ = + l)d n . Furthermore we assume a constant 

variance of the perturbation term a 1 = o\ = . . . = g 2 n which is estimated 
from existing data. Under these assumptions the target system inventory is 

a* = d n (v + 1) + <jyjv + l# -1 ^ , (5) 

and the order policy is z* = a* — a*_ x + D n - 1 = ( d n — d n -i)(v 4- 1) + 
D n -i. Considering the assumption of constant levels the estimation of future 
demands can be calculated using the floating averages d n = - J27=n-r 
of ordinal r. The resulting order policy is now z* = + 1) + 

D n - 1 = ^Cn-1 - fön-r-L 

3 Bullwhip Effect in Consequence of Deficiency of 
Information 

In practice the management of a storage system has the problem that it is 
not known which system inventory is needed to meet future demands. If there 
is no exchange of information within a supply chain prediction of sales can 
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only be created using the order data of the succeeding company. Because 
every company determines its inventory according to the own prediction of 
demand, the companies get data, which base on several prediction processes. 
A funded predication about the real consumption is no longer possible and 
there is a risk of a relevant derivation from the effective demand of customers. 
This amplification of the variance as a result of the distortion of informations 
is formally derivated in the following section using the order policy which has 
been described previously. 

The variance of an order policy with independent not identically dis- 
tributed demand can be determined using var(a + b) = var(a) + var(b) + 
2 cov(a,b). Because of the independence of D n -\ and D n _ r _i the covariance 
equals zero. Furthermore we assumed var(D n - 1 ) = var(D n - r -i). This leads 
to the variance of the amount of orders z n which satisfies 

var(z n ) = — —var(D n -i) > var{D n - 1 ). (6) 

The variance of the ordering policy is greater than the variance of the demand 
which causes the bullwhip effect within a supply chain. Moreover we can 
realise the dependence of the amplification from the delay of delivery and the 
interval used for the prediction. A great delay of delivery forces the variance 
to grow, while a long interval for the prediction increases the robustness 
against outliers. However the longer the interval is chosen the worse is the 
adaptability considering a change of the demand level, which leads finally to 
increasing costs of storage. Therefore at the choice of r we have to find a 
compromise between adaptability and robustness of the prediction. 

4 Implementation of an Information Exchange System 

To estimate the impact of the deficit of information we enhance the supply 
chain by implementing a shared information system. The exchange of infor- 
mations takes place at the end of every period. Here all the companies passes 
their current inventory as well as the occurred demands in this period. A 
multi-stage supply chain enhanced with an information exchange system is 
shown in figure 1. An important aspect of the information exchange process 
is the availibility of the point of sales data within the whole supply chain. 
These data are collected on the first stage of the supply chain (stage i = 1). 



4.1 Order Policy 

For non identically and normally distributed demand and delays of delivery 
the optimal system inventory for a company on stage i in the supply chain 
equals according to equation (5) 

a n,i = d n ,i( v + 1) + ÖiVV + l«P -1 (fct). 



(7) 
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Fig. 1. Multi-stage supply chain with information exchange system 



Here ki denotes the cost structure of the company. By implementing an in- 
formation exchange system for a company on stage i it is now possible to 
determine the optimal order of the company on stage i — 1 of the sup- 

ply chain. Thus the calculated order describes the known demand D n The 
company now only has to estimate the demands of the v following periods 
applying the method of floating averages of ordinal r. The data which can 
be used to perform this informations are the real market demands [4] . 

The optimal system inventory for a company on stage i of a supply chain 
applying an information exchange system can now be calculated according 
to 

= D n ,i— 1 4“ d n ,marketV + (J market \/v*& ( ki ). (8) 

Applying z*^ = a* ^ — a *_ x a + the or der policy of a company on stage 

i is determined by 

Zn,i == Dn,i—l 4 (Dn-l, market D n —T—1, market) • (9) 

’ T 

In the special case of immediate delivery (y = 0) and using the information 
exchange system according to equation (9) for the companies on stages i = 
2,3,... it is not necessary to have a storage system to keep inventory. The 
orders of the ordering companies can be calculated, as long as the ordering 
policies are known. Thus there is no uncertainty, and a synchronised flow of 
material and information can be observed. Only the company on the first 
stage of the supply chain has to keep inventory in order to deal with the 
stochastic market demand. 



4.2 Quantification of the Bullwhip Effect 

The variance of a order policy according to equation (7) and using the as- 
sumption var{D n -i >rnark et ) = uar(D„_ r _i )marfeet ) = <?market can be calcu- 
lated to 

2 2 

var(z* 4 ) = Var(Dn t i-i) + V parket _ ( 10 ) 
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Using the shared informations within the whole supply chain an increase of 

i , 2 a 2 

the variance of the orders of — on every stage of the supply chain can 
be observed. 

Declaring the market as the stage 0 of the market (d n ^Markt = d n $) 
the amplification of the order of a company on stage i of the supply chain 
compared to the variance of the market demand equals 

VCLT{^Z n j) (J market ^ * (H) 



4.3 The Impact of Information on the Bullwhip Effect 



To analyse the impact of the shared information within the supply chain on 
the bullwhip effect it is usefull to normalize the variance of the orders on a 
stage i of the supply chain on the variance of the market demand 
In the case of using shared informations the normalized value is calculated 
according to equation (11) to 



var ( z n,i) 

a 2 

market 




Qi,info 



( 12 ) 



for o market > 0. Without shared information the normalized value for the 
bullwhip effect equals using equation (6) 



var «i) 

a 2 

market 



(v + T + l ) 2 + (t/ + l ) 2 
T 2 



= Qi- 



(13) 



Example In figure 2 the quotient 

/ (i/+t+1) 2 +(i/+1) 2 V 

= i - 2 . .. 2 ) . (14) 

Qi,info 1 + i ^2 

is shown for r = 12. It can be observed that the delay of delivery has a big 
influence on the reduction of the bullwhip effect using shared informations. 
In general the potential of an information exchange system increases signif- 
icantly for companies with a big distance to the market. The improvements 
for the company on the first stage of the supply chain are caused by the use 
of point of sales data. 



5 Summary 

The main content of the investigations in this paper was the analyses of a 
sequential supply chain, whose participants use simple mathematically de- 
veloped order policies. Under the assumption of a nonexisting exchange of 
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Fig. 2. Quotient qi/qi,info of amplification factors, r = 12 



information the bullwhip effect could be proven mathematically. It could be 
shown that under deficits of information the order policies lead to an ampli- 
fication of variance. To weaken the bullwhip effect an information exchange 
system has been implemented. Through this measure the variance of ordering 
could be decreased significantly. 

Storage control models are pretentious dynamic optimization problems. 
Particularly under consideration of several sequentially arranged companies 
in a supply chain the models show a high complexity. In further investigations 
we consider the problem of the complexity of the supply chains as well as the 
inclusion of information systems along the complete supply chain. 

References 

1. Girlich, H., Köchel, P., Kiinle, H. (1990) Steuerung dynamischer Systeme: 
mehrstufige Entscheidung bei Unsicherheit, Birkhäuser, Basel 

2. Bellman, R., Glicksberg, I., Gross, O. (1955) On the Optimal Inventory Equa- 
tion, Management Science, 1, 83-104 

3. Heyman, D.P., Sobel, M.J. [eds.](1990) Stochastic Models, North- Holland, Am- 
sterdam 

4. Faißt, B. (2003) Dynamische Effekte in Supply Chains: Der Bullwhip-Effekt als 
Ursache von Beständen bei Informationsdefiziten, Wissenschaftliche Berichte des 
Institutes für Fördertechnik und Logistiksysteme der Universität Karlsruhe, 59 





Analyzing the Bullwhip Effect of 
Installation-Stock and Echelon-Stock Policies 
with Linear Control Theory 



Kai Hoberg 1 , Ulrich W. Thonemann 1 , and James R. Bradley 2 

1 Institute of Supply Chain Management, Münster University, 
Universitätsstraße 14-16, 48143 Münster, Germany 

2 S. C. Johnson Graduate School of Management, Cornell University, 
321 Sage Hall, Ithaca, NY 14853-6201, USA 



Abstract. We analyze the effect of installation-stock and echelon-stock policies 
on order amplification in a serial two-echelon supply chain. As orders are passed 
through a supply chain, order oscillations and inventory oscillations are typically 
amplified at each echelon. This behavior is referred to as the bullwhip effect. To 
analyze how different inventory policies affect order and inventory oscillations we 
apply linear control theory. We show that the echelon-stock policy outperforms the 
installation-stock policy with respect to both order and inventory oscillation 



1 Introduction 

The costs of carrying inventory can be immense. Inventory accounts for 30% 
of the current assets (Stevenson [12]) while inventory carrying costs are esti- 
mated between 20% and 25% of the inventory value (Lambert and Stock [9]). 
Therefore, inventory-control policies that reduce inventory have become an 
important stream of research in operations management. Cost-based optimal 
inventory policies exist for many situations (e.g. Zipkin [14]). They minimize 
some expected cost criteria, such as the expected sum of inventory-holding 
and backorder-penalty cost. However, with these approaches, the dynamic 
behavior of a system is difficult to analyze. Therefore, we use a different ap- 
proach in this paper - linear control theory. As described by Towill et al. 
[13], the linear control theory approach focuses on the fundamental perfor- 
mance of inventory policies. With linear control theory, the supply chain is 
described and characterized by its input-output behavior. The supply chain 
is represented in the frequency domain by transfer functions which can be 
analyzed conveniently. In recent years, the approach has been applied widely, 
e.g., by Dejonckheere et al. [2], to analyze forecasting approaches; by Disney 
and Towill [5], to study a vendor managed inventory system, and by Hafeez 
et al. [8], to design a steel supply chain. For an extensive overview of appli- 
cations of linear control theory to inventory and supply chain management, 
we refer to Ortega [11]. 

In this paper, we apply linear control theory to analyze the effect of inven- 
tory policies on the amplification of order and inventory oscillations, which 
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are major topics in supply chain management. Small oscillations of customer 
demand are significantly increased at each echelon of a supply chain. This 
behavior was first identified by Forrester [6] and is referred to as the bullwhip 
effect by Lee et al. [10]. High order oscillations force companies to hold high 
levels of inventory to buffer against shortages or to provide high production 
capacities to react to orders quickly. Closely related to order oscillation is 
inventory oscillation. Inventory oscillations force companies to provide high 
warehouse capacity and safety stock. 

The goal of our paper is to improve the understanding of how inven- 
tory policies can be represented with linear control theory and how the 
installation-stock policy (IS policy) and the echelon-stock policy (ES pol- 
icy) affect order amplification and inventory oscillation in supply chains. The 
remainder of this paper is organized as follows: In Section 2, we introduce 
the linear-control-theoretic representation of supply chains and present our 
supply-chain model. In Section 3, we define performance measures and ana- 
lyze the inventory policies. In Section 4, we summarize our findings. 

2 Representing Inventory Policies with Linear Control 
Theory 

In this section, we show how linear control theory can be used to model 
supply chains, discuss the inventory policies we analyze, and describe the 
assumptions of the model. For details on linear control theory, we refer to Dorf 
and Bishop [4] or Franklin et al. [7]. In linear control theory, the properties 
of a system are characterized by the transfer function. A transfer function 
G (z) = represents the system output Y ( z ) in relation to its input X ( z ) 
in the frequency domain. The transfer function G(z), when multiplied by 
an input X(z) yields the response of the system in the frequency domain. 
G(z) can be used to analyze how the output reacts to an input of a certain 
frequency and amplitude. In addition, transfer functions can be analyzed 
to obtain a general understanding of the system’s behavior with respect to 
stability, dampening, steady-state accuracy, and responsiveness. The Laplace 
transform and z-transform are the mathematical tools of linear control theory 
that represent the system behavior in the frequency domain. The Laplace 
transform is used for a continuous-time representation of the system; the 
^-transform for a discrete-time representation of the system. 

Figure 1 shows the structure of the two-echelon supply chain model we 
consider. Customer demand originates at echelon 1. Echelon 1 delivers the 
goods to the customers and is supplied from echelon 2, which is replenished 
from an outside supplier. Orders are placed periodically. The order quantity 
is unrestricted. The lead times are deterministic and integer. There are no 
capacity constraints, inventory constraints, and information delays in the 
supply chain. If inventory at echelon 1 drops to zero, customer demand is 
backordered. If inventory at echelon 2 drops to zero, goods are borrowed 




65 



Supplier 




Customer 



Echelon 2 Echelon 1 

Fig. 1. Supply chain structure 



from an outside source and are shipped to echelon 1 with no additional time 
delay. Echelon 2 restocks the outside supplier before inventory is stocked at 
the echelon. We note that this is a rather restrictive assumption, but the 
assumption is necessary to make the mathematical model tractable and is 
commonly used in linear control theory (e.g. Disney and Towill [5]). 

Two key parameters are the lead time t l n and the inventory-cover time t c n . 
The lead time, i.e., the delay between the placement of an order at echelon n 
and the arrival of the goods at echelon n, is t l n . The inventory-cover time is 
a factor that reflects the safety-stock requirements at echelon n. It describes 
the target inventory level as a multiple of the demand forecast at echelon 
n. The sequence of events is as follows: At the beginning of the period, the 
demand forecast is calculated. Then, an order is placed. Next, the shipments 
that were ordered t l n periods earlier are received. Finally, demand is received 
and goods are shipped to the customer. 

The inventory policies we analyze are the IS policy and the ES policy. 
Installation- stock policy: The IS policy uses the sum of the on-hand inventory 
and pipeline inventory (i.e., the goods in transit) at echelon n as the decision 
state. To forecast the demand, single exponential smoothing with smoothing 
factor a n (0 < a n < 1) is applied at each echelon n to the local demand at 
that echelon. Under an IS policy, the target installation stock TIS n at echelon 
n is calculated by extending the demand forecast over the lead time and the 
inventory-cover time: TIS n = F n • (t l n + 1£), where F n denotes the demand 
forecast at echelon n. Thus, in steady state with constant demand, the actual 
inventory equals the forecasted demand multiplied by the inventory-cover 
time. The orders O n are calculated as the error between target installation 
stock and actual installation stock, AIS n = TIS n — I S n , plus the latest 
demand forecast F n : O n = AIS n 4- F n . 

Echelon-stock policy: The ES policy is an extension of the IS approach 
that bases order decisions on system- wide information (Clark and Scarf [1]). 
Demand data and inventory information of downstream echelons are shared 
with the upstream echelons of the supply chain. To forecast the demand at 
echelon n, single exponential smoothing with smoothing factor a n is applied 
to the demand at echelon 1 . The echelon stock is the sum of the installation 
stock of an installation and all downstream installations. The target echelon 
stock T ES n at echelon n is calculated by extending the demand forecast over 
the lead times and inventory-cover times of the echelon and all downstream 
echelons: TES n = F n • + ££)• Orders are calculated as the error 
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Fig. 2. Block-diagram representation of ES policy 

between target echelon stock and actual echelon stock, AES = TES n — ES n , 
plus the latest demand forecast: O n = AES n + F n . 

To derive the transfer functions for the IS and ES policies, a set of system 
equations must be solved. While the transfer function of the IS policy was 
derived by Dejonckheere et al. [3], the transfer function of the ES policy we 
analyze has not been derived previously. Figure 2 shows the block diagram 
of the ES policy in the z-domain. 2{Y^ T=to x(r) dr} = is the z- 

transform of the time-discrete summation, Z{x(t — T)} = z~ T • X(z) is the 
^-transform of a time delay of T periods, and ~ ~ j ^ X(z) is the ^-transform 
of single exponential smoothing with a smoothing factor of a applied to the 
time series x(t). In the block diagram, the additional delay of one period 
z~ x is required to ensure the correct sequence of events. It does not induce 
any additional delay into the system. We denote the transfer function of the 
orders at echelon n in response to the demand by Go n (z) and the transfer 
function of the inventory at echelon n in response to the demand by Gi n (z). 

3 Analysis 

In this section, we analyze and compare the IS and ES policies. We introduce 
several performance measures to study the performances of the inventory 
policies. The performance measures are based on the H^- and i^-norms from 
the Hardy space and are applied to the transfer function G(z). The ü/ 2 -norm 
is defined as ||G(2r)|| 2 = ^ §\ z \ =x G*(z)G(z)z~ 1 dz = ± |G(e*°)| 2 dw 

and the üToo-norm is defined as = sup |G(e Jw; )|. 
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Fig. 3. Frequency-response plot of the order oscillation of IS policy and ES policy 
at echelon 2 with supply-chain parameters t[ = 4, t l 2 = 4, t\ — 1, t\ = 1 




In an inventory-management context, the 772-norm of Go n (z ), HGorJ^j 
is the variance of the orders at echelon n if the demand is normally dis- 
tributed with variance one. The Tfoo-norm of Go n (z), || II oo ’ describes 

the worst-case demand amplification if the demand is a stationary oscillation 
with amplitude one. Both norms can be used as bullwhip measures of order 
amplification. Similarly, the 77 2 -norm of Gi n (z), ||G/ n || 2 , is the variance of 
the inventory oscillation at echelon n if demand is normally distributed with 
variance one. The TZoo-norm of Gj n (z), \\Gi n , describes the worst-case in- 
ventory oscillation at echelon n if the demand is a stationary oscillation with 
amplitude one. 

At echelon 1, the IS policy and the ES policy are identical and there 
is no effect of the parameters at echelon 2 on the performance of echelon 1. 
Therefore, we disregard echelon 1 and focus the analysis on echelon 2. We used 
a test bed with 500 supply chains with different lead times t l n , inventory-cover 
times ££, and smoothing factors a n to compare the performances of the IS and 
ES policies. The results show that the ES policy performs significantly better 
than the IS policy. Table 1 summarizes the average relative improvement 77 
of an ES policy over an IS policy for the different performance measures. The 
amplification of order and inventory oscillations under normally distributed 
demand, i.e., ||Go 2 II2 and ||Gj 2 II2 » are on average 38.93% and 40.34% lower 
under the ES policy than under the IS policy. The maximum amplification 
of order and inventory oscillations, i.e., || Go 2 II oo and \\Gi 2 II oo? are on average 
27.34% and 31.17% lower under the ES policy than under the IS policy. In 
addition, the ES policy outperformed the IS policy not only on average, but 
for all performance measures in each of 500 supply chains analyzed. 

The response of the policies with respect to any stationary demand can 
also be analyzed with the transfer functions. Figure 3 shows the order am- 
plification of the policies at echelon 2 as a function of the demand frequency 
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Table 1 . Average relative improvement of an ES policy over an IS policy 



IIC0J2 Halloo IIG/Ja IIG/alloo 

It 38.93% 27.34% 40.34% 31.17% 



Table 2. Performance measures for IS policy and ES policy (on = 0 : 2 =0.20) for 
supply chain parameters t[ = 4, t l 2 = 4, t\ = 1, t% = 1 

||So a |l 2 Halloo ||g/ 2 || 2 Halloo 

IS policy 5.09 5.44 6.35 13.08 

ES policy 3.28 3.44 4.75 9.15 



u for a supply chain with parameters t[ = 4, t l 2 = 4, t\ = 1, t% — 1. For 
constant demand ( lj = 0), the order amplification is one, i.e., there is no 
order amplification. As the frequency of the demand signal increases, the or- 
der amplifications of both policies increase. However, the order amplification 
of the ES policy is significantly lower than the order amplification of the IS 
policy. The frequency-response plot can be linked to HG 02 II 2 an d ||<2o 2 |loo* 
Since normally-distributed demand is equivalent to a signal with equal am- 
plitudes at all frequencies, HG 02 II 2 can computed as the integral of the 
functions in Figure 3. In this particular example, ||Go 2 || 2 5*09 for the IS 

policy and 3.28 for the ES policy. The worst-case response to a demand with 
a constant frequency, ||C?c> 2 lloo> corresponds to the maximum amplitude of 
the functions in Figure 3. In this particular example, \\Go 2 II oo 1S 5.44 for the 
IS and 3.44 for the ES policy. From the frequency-response plot in Figure 4 
we can see that similar results hold for inventory oscillations. However, we 
find that, for a few frequencies, an IS policy can be favorable to an ES policy 
with respect to inventory oscillation. Table 2 summarizes the performance 
measures of this example. 

The results of our numerical experiments indicate that the ES policy 
clearly dominates the IS policy both in terms of order and inventory oscilla- 
tions. Since inventory oscillations are lower under an ES policy than under 
an IS policy, the ES policy requires less safety stock than the IS policy, which 
in turn results in lower inventory-holding costs. Since order oscillation is also 
lower under the ES policy than under the IS policy, the ES policy also results 
in lower production costs than the IS policy. 

4 Conclusion 

In this paper we have used linear control theory to model IS and ES inven- 
tory policies in a two-echelon supply chain. The discrete transfer function 
approach we chose describes the input-output behavior of a supply chain in 
single equations. We have shown how different performance measures based 
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Inventory 
Oscillation 
at Echelon 2 




Fig. 4. Frequency-reponse plot of the inventory oscillation of IS policy and ES 
policy at echelon 2 with supply-chain parameters t[ = 4, t l 2 = 4, = 1, t 2 = 1 



on Hardy-space norms can be applied to the transfer functions. Since the 
mathematical complexity of these performance measures is very high, gen- 
eral analytical results could not be obtained, but we were able to gain insights 
into the performance of the IS and ES policies by numerical analysis of the 
transfer functions. With respect to order amplification, the ES policy is su- 
perior to the IS policy. This could be observed for all reasonable smoothing 
factors in response to normally distributed demand, to worst-case stationary 
demand, and over all demand frequencies. For inventory oscillation, similar 
results hold with respect to normally distributed demand and to worst-case 
stationary demand. 

In order to decrease the order amplification of an IS policy, Dejonckheere 
et al. [3] introduce a partial correction of the error between target and ac- 
tual installation stock. However, by correcting the error over several periods, 
the policy’s responsiveness to non-stationary demand, e.g., a step change in 
demand, can decrease. We leave the analysis of this dynamic behavior of sup- 
ply chains in response to non-stationary demand as well as the influence of 
information delays in ES policies for further research. 
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Abstract. We consider a single-stage production inventory problem under peri- 
odic review with stochastic demand and stochastically proportional yield. Hold- 
ing, shortage and ordering costs are assumed to be strictly proportional. The opti- 
mal ordering policy is known to be of a non-linear type. Linear approximation of 
this policy is a commonly used heuristic approach. Our focus is on the application 
of linear approximations under procurement leadtime conditions for an infinite ho- 
rizon setting. 



1 Introduction 

The problem of stochastic yield is experienced in several industrial production 
processes. Particularly, yield uncertainty is inherent in processes that are not com- 
pletely controllable such as chemical processes or semiconductor fabrication. 

We consider a single-stage production problem with stochastic yield and de- 
mand. Production yield is a random fraction of the production order. This yield 
model is usually referred to as stochastically proportional yield. Yield and demand 
distributions are assumed to be stationary and independent. Procurement, holding 
and shortage costs are strictly proportional. Any unsatisfied demands are back- 
logged. We also allow for a deterministic production leadtime. 

Production inventory problems with yield uncertainty as described above have 
been subject of a number of publications. For problems with zero leadtime it has 
been shown in [3, 4] that the optimal production policy is an extension of the well- 
known order-up-to policy for the deterministic yield case which, however, results 
in a non-linear procurement rule that hardly can be implemented in practice. In in- 
dustry facing yield problems usually linear procurement policies are applied as we 
find in MRP approaches where net requirements are inflated by constant yield fac- 
tors. For zero leadtime linear policy approximations have been considered by sev- 
eral authors (see [1, 2, 4, 6]). In extending this line of research our paper focuses 
on the development of most effective linear approximations in the case of produc- 
tion leadtime. 
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In the next section of our paper we formulate the optimisation problem and dis- 
cuss the application of linear policy approximations. In a subsequent section, the 
linear approximation is extended to the condition of a non-zero procurement lead- 
time, and numerical results for optimising a linear procurement policy are re- 
ported. We end with some final conclusions. 



2 Optimisation Model and Heuristic Approaches 

In the sequel we will consider a single-stage single-item production facility with 
stochastically proportional yield, i.e. the output acceptable is a random fraction of 
the order quantity. Holding, shortage and procurement costs are assumed to be 
strictly proportional, there are no fixed procurement costs. A procurement lead- 
time is not (yet) considered. The following notation is used: 

h: holding cost per unit 

v. shortage cost per unit 

c : procurement cost per unit 

r: stochastic demand with pdf/(r), cdf F(r), mean p r and variance a] 

z: stochastic yield fraction with pdf g(z), and cdf G(z), mean p z and 

variance 

C : total cost 

x\ initial inventory minus backorder 

p : procurement quantity 

We start with the single-period problem. For a given inventory level x and pro- 
curement quantity p, the expected period total cost is 

00 X+Z-p ( 1 ) 

L(x,p) = c- p + h- Jg(z) J (x + z- p-r)- f(r)-dr-dz 

0 0 

00 00 

+* / -Jg(s) J (r-x-z- p)- f{r)-dr-dz . 

0 x+z-p 

In the case of multiple periods the following recursive relationship holds for the 
minimal cost C n of an n-period problem. 

C n (x) = min^L(x, p ) + E [C^, (x + z-p- r)]j ^ 

In [3, 4] it is shown that the optimal policy p*(x) for this problem is an exten- 
sion of the order-up-to policy in case of certain yield. It can be described by 
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p\x) 



P(x) if x<S + 
0 if x> S + 



( 3 ) 



where P(x) is a procurement function decreasing in x with dP/dx <- 1 and 
P(5 + )= 0 . 

The policy in Eq. (3) holds for the single-period as well as for the multi-period 
(and even for the infinite-period) case. For the single-period problem, the pro- 
curement level S* is given by a newsvendor-type solution 



S + =F 1 (a ) with 



v ~ c /ju z 

a = u -^ 

v + h 



( 4 ) 



Obviously, S* is only affected by the mean yield rate, but not by yield variabil- 
ity. If procurement costs are only charged for procurement yield (i.e. z • p ), S* is 
completely identical to the standard newsvendor formula (see [3]). In the multi- 
period case, procurement level S* is larger than the newsvendor level and is af- 
fected by the complete yield distribution function. For this reason a myopic policy 
will not be optimal in a multi-period decision framework. However, when apply- 
ing the single-period solution as myopic rule in the stationary infinite-horizon 
case, an easy approximation for S* - according the results for the certain yield 
problem - is given by omitting the procurement cost term in Eq. (4): 



S + = F l 



v + h j 



( 5 ) 



Unfortunately, the procurement function in Eq. (3) cannot in general be given 
in a closed form, except for the single-period case with specific demand and yield 
distributions (like uniform or exponential pdf, see [3]). For uniformly distributed 
demand and yield rate with re[0,r + ] and ze[0,z + ] the result in [3] requires a cor- 
rection as shown in [5]: 



'’W= 



z + y3-(l -a)r + 



if 0<x<(3a-2)-r + 



if (3 a - 2) • r + < x < a • r + = S 



( 6 ) 



with S + from Eq. (4). So, it turns out that also for very special cases P(x) usu- 
ally can be expected to be of a complex non-linear form. Even if the optimal pro- 
curement function could be described analytically in more general cases, such a 
procurement policy would not be attractive for practical applications because of its 
non-linearity. For that reason we will consider approximations of P(x) of which 
the most tractable seems to be a linear one, being described by two parameters Po 
and ß\ 
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P(x) = P 0 -ß-x (7) 

Hereby, we get for the respective procurement level: S + = P 0 /ß .In literature, 
different suggestions for this kind of approximation have been made in [2, 4, 6], 
where always S + is fixed at the newsvendor level in Eq. (5) and different /?- values 
are chosen like: (I) ß-Hp z to represent the optimal policy in the certain yield case, 
or (II) ß = ju z ! {ju 2 z + <J 2 Z ) which has been derived by the authors in quite different 

ways. Unlike in these approaches, in [1] the authors fix ß to l/ju z and choose a Po 
value such that S + is different from the newsvendor solution resulting in a linear 
function P m (x) differing from the functions P 7 (jc) and P n (x) for the above ap- 
proximations. Fig.l gives a graphical representation of how the exact order policy 
P(x) is approximated by the different linear heuristics. 




Fig. 1. Linear approximation to the non-linear optimal policy 

For developing the P(x) function the problem can be reformulated using the 
definition of a random variable aggregating the variability of demand and yield 
T j = r -( z -j U ^.p with pdf ftj , (see [1]). Note that the distribution of this modi- 
fied demand variable depends on the production quantity p. The expected inven- 
tory available for demand fulfilment is y = x + p z • p , so that y -rj = x + z- p — r 

represents the end of period inventory level. Similar to the newsvendor model, the 
expected single-period cost function (omitting procurement cost) is 

y 00 (8) 

L(x, y) = h ■ J(j - ri) ■ f n (77) • dr) + v ■ J(?7 - y) ■ /, (rj) ■ dtj 

0 y 

From the first order derivative with respect to y we receive as an optimality 
condition 
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r,W+)(z-y)-Z&£-d v = 



v + h 



(9) 



which obviously deviates from the simple newsvendor solution. The integral 
term in Eq. (9) is due to the fact that ij depends on y. However, in [1] this differ- 
ence is neglected and the expression without the integral term is used to derive a 
myopic heuristic. 

Thus, procurement function P(x) is implicitly given by 

Prob{r-(z-M z )-P^*+M z -p}=^j i • (10) 



P(x ) now is approximated by the linear function 

P(x) = P 0 - — -x 
Mz 



(ID 



where P 0 is determined in such way that equation (10) holds when inserting 
p = P(x) and fixing x to a specific value (see [1]). Since this heuristic has proven 
to perform quite well, it will be chosen as basis for an extension to a setting with 
production leadtimes. 



3 Linear Heuristics in Case of Production Leadtimes 



In this section, we concentrate on the aspect of integrating a production leadtime 
in a linear heuristic. With a leadtime of A, a procurement order p t , placed in period 
t, will be received after A time-periods as a quantity z t • p t of acceptable items. 

Since a decision in t will replenish the inventory in t+A, we introduce an inven- 
tory position x' t at the beginning of period t, aggregating the present stock on 

hand x t plus the yield expectation of all outstanding orders, 




( 12 ) 



The respective linear procurement policy extending (11) can be written as 



Pz 



(13) 



It orders up to the critical inventory level S t = SST t +(A + l)*// r where SST t 

represents the safety stock. Note that in the procurement leadtime case, despite the 
stationarity assumption, the safety stock can vary from period to period due to 
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yield uncertainty affected by the specific outstanding orders. Extending the zero 
leadtime case we get for the modified random variable rj t 



x x 

V, =Z r > + ;-Z( z <-/-/0-A- i 

1=0 1=0 



(14) 



For the expected inventory position after the current order is received we define 

A (15) 

p t _i = x,+ß z -p, ■ 

i = 0 



y> ~ x t + M z '^j p t -i — x t + m z ' p, 



After inserting both variables into the optimality condition 
Prob {ij t < y t } = vj(v + h) we get the conditional equation 



Prob <j C : = Z ~ X z >-< ‘ P-i ~ z > ' P, (*') ^ ~ Pz ' X Pt-t I 1 = 

i= 0 



(16) 



v + h 



which defines the non-linear procurement function. In order to get a linear ap- 
proximation we have to insert 



p,(x') = — (SST,+(A+l)- Mr -x') 
Pz 



(17) 



from Eq. (13) for /? f (jt') in Eq. (16) and set jt' to a specific value, denoted by 
x . Additionally assuming that Q is (approximately) normally distributed, we can 
solve Eq. (16) for SST t . Choosing a specific level X corresponds to determining 
the point (x, /?,(.£)) of the non-linear procurement function which will be used as 

intersection point for the linear policy approximation as depicted for function 
P UI {x) in Fig.l. Following this line of consideration and choosing x = SST t (as 
proposed in [1] for the zero leadtime case) yields: 



SST = 0“ 



v + h. 



(A + 1) • cr r 2 + <J 2 Z • ^ pf_i +(A + 1) 2 • cr 2 



Mr 



(18) 



where O stands for the standard normal cdf. 
Alternatively, choosing x = E[x r ] = SST t + A- ju r results in 



SST : =0' 



v + h 



V i=l M z 



(19) 



which differs from Eq. (18) by the multiplier ( A + l ) 2 of the risk term 
a\ • jd 2 r j ju 2 . In order to investigate the impact of using different approximation 
points x , we parametrise this multiplier by the term y. 
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SST=<I>- 



v + h t 



(A+iy 



2 2 

a; +cr; 



■Y^pI.+v 



,b_ 

mI 



( 20 ) 



In order to get an idea of how to choose y best, we tested this approximation 
numerically over an infinite horizon under different cost, demand and yield sce- 
narios. It turns out that the optimal level of this parameter is y=l which supports 
the choice of x = E[x'] for the approximation point. 

Finally, we will present some typical numerical results that show how the 
above approximation with the safety stock setting from Eq. (19) performs in com- 
parison to other linear approximations. As another linear approach that we include 
in our comparison, we set ß=\lfi z and a fixed procurement level S* as in the no- 
defects (newsvendor) model as proposed in [6]. 

In our scenario, demand is gamma-distributed with 100 and <r^=20, yield is 
beta-distributed with /^=0.5 and cr z =0.125, holding and shortage costs are h - 3 and 
v*=27. A set of 3 heuristics is compared. Heuristic I with x = E[x'] is represented 

by Eq. (19) whereas heuristic II is based on the approximation point x = SST as 
given by Eq. (18). For completing the comparison also the linear heuristic with a 
leadtime adjusted newsvendor S + and ß=l/jLt z , referred to here as heuristic III, is 
reported. 



Table 1. Cost performance of different linear heuristics 



X 


Q 


Cii 


On 


0 


100 


100 


114 


2 


100 


120 


116 


4 


100 


142 


116 


6 


100 


161 


116 


8 


100 


179 


116 


10 


100 


195 


116 



Numerical results are given in Tab.l. Total costs computed for heuristic I were 
standardised to 100 and results obtained for the other heuristics are expressed rela- 
tively to C/. From the data it can be seen that depending on the leadtime, the 
choice of y significantly impacts the cost performance of the linear approximation. 
It becomes apparent that heuristic II performs worst with extremely large devia- 
tions from C/, which is a result of a safety stock level fixed too high in Eq. (18). 
Disregarding yield uncertainty, the leadtime adjusted newsvendor heuristic gener- 
ates an insufficient safety stock level and therefore causes an increased occurrence 
of stockouts. Applying this heuristic yields a quite large cost deviation from C h 
however, the gap is neglibly affected by the leadtime. 
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4 Conclusions 

Our results show that applying a linear approximation to the optimal order policy 
requires determining the approximation point x which can be shown to have a 
considerable impact on the performance of this approach. Thus, fixing this point in 
a proper way is an important issue when developing a linear heuristic as shown in 
last section. Numerical results suggest that the approximation point should be cho- 
sen to represent the expectation of the inventory position x ' . Further on, heuristics 
that do not account for the yield risk inherent in the individual outstanding orders 
provide a rather poor performance. 
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Abstract. This paper is intended to give insights into the simultaneous technology 
choice and investment time problem within a dynamic deterministic framework 
consisting of a product life cycle and an availability cycle of returns. A Net Present 
Value approach is employed for solving the problem. 



1 Introduction 

Developing new products and setting up production facilities requires firms to 
choose between different technologies in order to manufacture the product. 
Besides quality and service aspects, this decision has an impact on direct 
production costs and necessary capital expenditures in building new facilities 
or modifying existing ones. In the context of reverse logistics, the product 
design decision also affects the possible options on how to deal with returned 
used products, and it has to be extended by the question of whether to design 
and produce a product for a single life time only, or in such a way that it 
or its components can be made capable for a second use after some recovery 
process. This can yield additional profit, as some of the added value will not 
be lost through material-recycling or disposing of the returned item. On the 
other side, there can be higher expenses for setting up production facilities, 
as well as higher production unit costs, that are caused by the necessity to 
add properties to the product for making it recoverable. 

Although there exists an enormous amount of literature on operative is- 
sues in reverse logistics (for a literature survey see [1]), aspects of financial 
justification, being highly influential to investment decisions, have not been 
addressed in detail so far because they require both a dynamic consideration 
as well as the application of discounted cash flow techniques, which sub- 
stantially complicates the investigation. In recent contributions to dynamic 
product recovery (see [2] for an overview), it is assumed that both, produc- 
tion and remanufacturing, facilities already existed, i.e. the technology choice 
has been made before. Since introducing a technology for remanufacturing 
may require additional investments, it remains to be seen if these investments 
will pay off or not. Moreover, it is not necessarily useful to set up a reman- 
ufacturing facility immediately at the time production starts, because this 
usually requires a considerable capital commitment while not yet having a 
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large number of returns available. Therefore, a decision has to be made when 
to introduce this process. Another question is how the possibility to hold 
returned items in a strategic inventory influences decision making. 

The paper is organized as follows. In Section 2, three investment projects 
representing different environmental policies are introduced, and for each 
one of them the optimal project parameters are determined. The last section 
provides conclusions and possibilities for further research. 

2 Three Investment Projects 

This section deals with three basic investment projects. Three types of oper- 
ational cash outflows are considered: investment expenditures, constant pro- 
duction, remanufacturing and disposal per unit payments as well as out-of- 
pocket inventory holding costs. Recovered products are regarded as a perfect 
substitute to newly produced items, and thus are sold to the same market. 
Revenues, as well as payments connected with the take back of used products 
are not taken into account, since both demand as well as returns are assumed 
to be given. Furthermore, since we are performing a long-term analysis, all 
operative processes are supposed to have sufficient capacity available. We con- 
sider a demand/return scenario complying with the following assumptions: 

A.l Demand d(t) is assumed to be a deterministic continuously differentiable 
function of time showing the typically unimodal shape of a product life cycle 
with its maximum located at t™ ax > 0. 

A, 2 Returns u(t) are not available prior to a time point A > 0 and otherwise 
given by an unimodal function of time with u(t) > OVt > A representing 
the availability cycle of returns. Further, the return function has a maximum 
t™ ax and is continuously differentiable for t > A. 

A. 3 There exists at most a single intersection point of demand and return 
functions £/ > max-ft™®*, A} for which it holds u(t) < d(t) if t < ti and 
u(t) > d(t) if t > ti. If there is no such intersection because demand always 
exceeds the return rate, ti is assumed to equal infinity. 

Figure 1 illustrates the situation under consideration. Using A and ti , one 
can distinguish between three regions. In Region I, which ends at A , no re- 
turns are accessible. Demand has to be filled completely by producing new 
items. Region II shows less returns than demand (excess demand) and Region 
III is characterized by excess returns and decreasing demand. 

Regarding the environmental policy of the firm and the existence of a 
strategic inventory that keeps returns for a later use, the following capital 
investment projects are considered: 

(a) Design for single use. Products are designed in such a way that they 
can not be remanufactured. Thus, all returns have to be disposed of at 
costs c w , which can be positive if actual payments are necessary, or nega- 
tive if there exists a positive salvage value. The corresponding investment 
at t = 0 is Kp > 0. Direct unit production costs are c s p > 0. 
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(b) Design for reuse. Products are designed such that they can be made 
capable for another life time. Investment expenditures at t = 0 amount to 
k; > K p1 producing each item would cost c p > c p . Both values exceed the 
above expenses for single use design because of additional requirements 
needed for remanufacturing. Used products can be remanufactured at 
costs c r > 0 after introducing a remanufacturing process at time t r > A. 
This leads to a cash outflow of K r > 0. A possibility to store returns is 
not considered. If returns exceed demand, they must be disposed of. 

(c) Design for reuse with strategic inventory. In addition to (b), it 
is possible to keep returns for later use in a recoverables inventory, e.g. 
at a time where remanufacturing is not yet possible, i.e. at t < t r . The 
inventory level at t is denoted by y u (£). Out-of-pocket holding costs per 

item and time unit are given by h u > 0. 

* 

The discount rate is denoted by a. Further assumptions are as follows: (1) A 
benefit must be realized if, instead of simultaneous production of a new item 
and disposal of the returned one, the latter is merely remanufactured, i.e. 
c p + c w > c r . (2) It is not advantageous to delay the disposal of an unneeded 
returned item because saved interests on the required expenses are lower than 
out-of-pocket costs incurred by holding the item, i.e. h u > ac w . 

2.1 Valuation of Investment Project (a) - Design for Single Use 

When assuming a single use product, the optimal dynamic policy is obviously 
to dispose of all returns immediately upon receipt, i.e. w*(t) = u(t). Demand 
is satisfied by synchronized production of new items (p*(£) = d(t)). This leads 
to the following expression for the Net Present Value 

poo 

NPV a =K;+ e~ at [c s p d(t) + c w w(i)] dt. (1) 

Jo 

NPV a can be considered as a benchmark against which the financial benefit 
of the other projects have to be compared. 
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2.2 Investment Project (b) - Design for Reuse 

Dynamic Policy. The capital expenditure of K r at time t r subdivides the 
planning horizon into two parts. Before t r , only production can be used to 
satisfy demand, and the same policy applies as for project (a). The optimal 
policy for t > t r is to remanufacture as many units as possible, to produce for 
excess demand, and to dispose of excess returns, yielding p*(t) = max{d(£) — 
u(t),0},r*(£) = min (d(t), u(t)}, = ma x{u(t) — d(£), 0} Vt > t r . 

The Net Present Value of project (b) NPV b depends on the investment 
time £ r , and the following non-linear optimization problem needs to be solved 

min NPV b (t r ) = K;+ T" e -a;t [c p d(t) 4 c w u(t)\ dt 4 e~ atr K r (2) 

tr Jo 

oo 

4 J e“ at [cp ma x{d(t) — u(t), 0} 4 c r min{^(t), d(t)} 4 c w max{u(£) — d(t), 0}] dt. 

t r 

It can be shown that based on the assumptions A.1-A.3, NPVb(t r ) is strictly 
decreasing for t r < A and at the limit, when t r approaches infinity. Depending 
on the parameters, either there exists a single local minimum between A 
and ti which is followed by a local maximum or the function is decreasing 
during the whole planning period [0, oo). The first derivative of NPVb(t r ) is 
a continuous function except for t r = A, given a jump discontinuity of the 
return function u(t) at A. 

Parameter Optimization. When choosing the investment time £ r , a trade-off 
has to be struck between the lower discounted value of the investment ex- 
penses K r if the introduction of the remanufacturing process is postponed and 
a larger realized recovery cost advantage if it is placed earlier. Reconsidering 
the dynamic environment as introduced before, a finite optimal investment 
time t* is located in Region II, and it must satisfy a break-even like condition. 

Proposition 1. If it exists , a finite investment time t* must be located within 
the half open interval [A, min{t^ ax , ti}), and one of the following situations 
must apply 

(i) u(t*)(c r v 4 -c w - Cr) = aK r and u(t*) >0 if t*> A, 

(ii) u{t* r )(c r p 4 c w - Cr) > OiK r if t* = A. 

Proposition 1 states that at £*, the current cost advantage of remanufac- 
turing u(t*)(c!p 4 c w — c r ) must at least earn interests on the investment, i.e. 
aK r . If (i) equality holds, the remanufacturing rate must increase at t* to 
start paying back the investment expenses. This is not possible later than 
either the time where returns reach their maximum t™ ax or the intersection 
time of demand and return rate t/, because in both cases the remanufac- 
turing rate must decrease thereafter. A special case (ii) may hold at time 
A , if there the return rate jumps. There exists no finite optimal investment 
time £*, if the initial interest rate on the investment exceeds the maximum 
possible current cost advantage, i.e. u (min {t™ ax ,ti}) (c p 4 c w — c r ) < aK r . 
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So far, only local conditions have been considered. Of course, the invest- 
ments required for the remanufacturing facility have to paid off. By compar- 
ing the values of the objective of the finite candidate satisfying Proposition 1 
with its limit as time approaches infinity, the following (global) condition for 
optimality of a finite investment time t* results: 

Proposition 2. For the optimal investment time £* it must hold that the 
total realized advantage of remanufacturing discounted to t* at least equals 
the expenses needed for setting up the remanufacturing facility 

poo 

K r < e ~ a ( t ~ t r) _|_ Cw — Cr ] min {d(t),u(t)}dt . (3) 

Comparison with Investment Project (a). There exists no simple rule for 
determining the best of the two investment projects, but by comparing (op- 
timal) Net Present Values it can be stated that project (b) is preferable to 
project (a) if the total discounted net advantage of remanufacturing 
e~ at (Cp 4 -c w — c r ) min{d(£), u(t)}dt — e~ at *K r exceeds the increase 
of the total discounted expenditures for the production process 
D\ = (k; - k;) + / 0 °° e-«* [cj - c s p ] d{t)dt. 

2.3 Investment Project (c) - Design for Reuse with Strategic 
Inventory 

Dynamic Policy . As an extension to project (b), returns can be stored in a 
recoverables inventory. Given a value for t r and for the system’s state at this 
time y u (t r ), the planning horizon can be subdivided into two parts. Prior to 
fy, the question arises when to start collecting returns in order to achieve 
the desired stock. Therefore, to each value y u (U) a. corresponding time point 
t e < t r can be given where disposal stops and all returns are put to stock, 
being defined by J t r u(s)ds = y u (t r )• Since stock-keeping can start earliest at 
A , the maximum possible quantity on stock at t r is limited. Optimal decisions 
in the first part are given by p*(t) = d(t), r*(£) = 0, w*(t) = u{t) V t < t e , 
and p*{t) = d(t ), r*(t) = 0, w*(t) = 0 V t e < t < t r . 

The solution of the second part is derived by using the optimal control 
framework presented in [4]. First, the recoverables inventory is depleted by 
filling excess demand from remanufacturing stored returns. This is completed 
at a time point t x >t r . Completion time t x must not be larger than tj because 
afterwards returns always exceed the demand rate. This gives another limiting 
condition for y u (t r ), i.e. y u (t r ) < f* 1 (d(s) — u(s)) ds. After t Xl the same 
policy is used as in investment project (b) because it is not useful to build 
up stock again, yielding the following optimal decisions in the second part 
p*(t) = 0, r*(t) = d(t ), w*(t) = 0 V t r < t < t x , and p*(t) = ma x{d(t) — 
^(£),0}, r*(£) = min (d(t), u(t)}, w*{t) = max{u(£) — d(t) 1 0} Wt > t x . Of 
course, this policy requires sufficient capacity and a high flexibility both in 
the production as well as in remanufacturing process. 
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In contrast to investment project (b) , the optimal solution to policy class 
(c) also includes the starting time of collecting returns t*. Restricting to finite 
solution candidates, we get the following optimization problem (4)-(7). 



min NPV C 



(t e ,t r ,t x ) = Kp+ f e at [cpd(t) + c w u(t)\ dt (4) 

Jo 

+ [ e~ at [cpd(t) + h u y u (t)] dt 4- e~ OLtr K r + f e~ at [c r d(t) 4- h u y u (t)] dt 
Jt e Jt r 

POO 

4- / e~ at [cp ma x{d(t) — u(t), 0} + c r min {u(t),d(t)} 4- Cw max{ti(t) — d(t ), 0}] dt 

Jt x 

f u(s)ds for t e [te,t r ] 

// e r u(s)ds - f* r (d(s) - u(s))ds for t G (t r ,t x ] (5) 

[ 0 otherwise 

and t x being implicitly defined by a function f(t e ,t r ,t x ) 

nt r pt x 

t x : f(t e ,t r ,tx) = / u(s)ds — / (d(s) — u(s))ds = 0 

Jt e Jt r 

subject to the restrictions 



with yu(t;t e ,tr,t x ) — \ 



A < t e , te < tr, f* 1 ( d(s ) — u(s )) ds > 0. 



( 6 ) 

(7) 



The objective function (4) incorporates all payments connected with the 
optimal policies in each of above distinguished regions. Function (5) is used 
to determine the inventory level and (6) gives an implicit definition of the time 
point t x where the inventory is depleted. Constraints (7) limit the admissible 
set as described above and are needed in order to assure a meaningful solution. 



Parameter Optimization. Due to the general assumptions on demand and 
return functions, objective (4) is not a (quasi-)convex function. Moreover, 
the admissible region is not even convex. Hence, conditions derived below by 
using standard methods of non-linear programming are only necessary for 
optimality. As there may exist several solution candidates, in order to find 
the optimal solution the objective values need to be compared. 

In the following, by exploiting first order necessary conditions, four differ- 
ent types of solution candidates are distinguished. For ease of representation, 
a candidate is given by a triplet (t e ,t r , t x ), bearing in mind that t x is a func- 
tion of the other two time points. But firstly, a general condition regarding 
the optimal holding time t* — t* is given. It must hold that t* — t* does not 
exceed a maximal holding time r, i.e. 



< - In 
a 



OL^Cp Cr) ~h hu 

— olc w -f- h u 



( 8 ) 



This holding time r comprises the same marginal criterion as known from 
[2] which balances the cost advantage of storing an otherwise disposed of 
returned item between t* e and t% in order to replace production by remanu- 
facturing at £* and the required holding costs. 

The following Propositions 3-6 present results for each of the cases. 
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Propositions (Case ( i ) - interior solution). A triplet ( t e ,t r ,t x ) with 
A < t e < t r < t x < tj is a solution candidate to problem (4)~(V of Case (i), 
if t x — t e = t and the following equation is satisfied 

—e~ atr [cp - Cr\d(t r ) = h u fl x e- at dtd(t r ) - e~ atx [c r p - c r )d(t r ) - ae" a ^A r . (9) 

Since t x — t e equals the maximal holding time r, the decision maker must be 
indifferent between (1) disposing of a (marginal) return unit arriving at t e , 
and producing a new one to meet demand at t x or (2) holding this item until 
t x when it is remanufactured to serve demand. Next, at t r one needs to be in- 
different between starting the remanufacturing process and thereby realizing 
the direct cost advantage of remanufacturing immediately or to postpone it 
which saves interests on the investment expenses. Then, a (marginal) demand 
d(t r ) is served from producing new items and a thus saved (marginal) return 
is kept until t x which results in holding costs and lowers the discounted value 
of the remanufacturing cost advantage. A Case 1 solution requires £/ — A > r. 

Proposition 4 (Case (ii) - complete use of interval [A,tj]). A triplet 
(t e ,t r ,t x ) with A = t e < t r < t x = ti is a solution candidate to problem 
(4)~(V °f Case (ii), if the following conditions are satisfied 

e~° iA c w d(t r ) > h u e~ at dtd{t r ) — e~° itr [c r p — c r )d(t r ) + ae~ atr K r , (10) 

—e~ atr [cp - c r ]d(tr) > h u /// e-^dtditr) - e' atl [c r p - c r ]d(t r ) - ae~ atr K r .{ll) 

Inequation (10) implies that it would be preferable to put additional re- 
turns in stock at t e for use at t r by simultaneously lowering t e and t r , even 
at the cost of an earlier investment. But this is not possible because A = t e . 
Likewise, using (11), the value of the objective could be lowered by post- 
poning investment time t r . This is also forbidden because we would need to 
increase t x = tj which again is not possible. A Case (ii) candidate only may 
exist, if ti — A < r. Therefore, it is not possible to have a situation where we 
could obtain solution candidates in both Case ( i ) and Case (ii). 

Proposition 5 (Case (in) - availability of returns is binding restric- 
tion). A triplet ( t e ,t r ,t x ) with A = t e < t r < t x < ti is a solution candidate 
to problem (4)~(V °f Case (Hi), if t x — A < r and 

-e- atr [cr - c r )d(tr) - h u e^dtd^r) - - c r ]d(t r ) - ae- atr K r .( 12) 

As before, the maximal holding time is not yet reached. But, in contrast 
to Case (ii), from (12) we are indifferent regarding the postponement of t r . 
Placing it earlier is also not possible, because t e is fixed to A. 

Proposition 6 (Case (iv) - availability of excess demand is binding 
restriction). A triplet (t e ,t r ,t x ) with A < t e < t r < t x — ti is a solution 
candidate to problem (4)~(V of Case (iv), ifti — t e <r and 

e~ octe c w d(t r ) = h u f* r e~ at dtd(t r ) — e~ atr [Cp — c r ]d(t r ) + ae~ atr K r . (13) 

In a situation were t x is fixed to ti , choosing t r requires indifference between 
disposing a (marginal) returned item at t e or using it to lower t r which in 
turn causes an increase in associated holding and interest expenses due to 
sooner investment but it also replaces production by remanufacturing at t r . 
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Comparison with Investment Project (b). Since investment project (c) is a 
generalization of (b) which uses a strategic inventory to maximize the benefit 
from replacing production by remanufacturing, it generally leads to a lower 
Net Present Value. Another interesting question is how the possibility to 
hold returns for later use affects investment time t r . Unfortunately, there is 
no unequivocal answer. An aspect that allows for postponing the investment 
time is that it no longer has a direct effect on the remanufacturability of 
returns since these also can be put to stock and remanufactured later. Other 
aspects make it possible to start remanufacturing earlier, e.g. a higher direct 
cost advantage of remanufacturing can be realized at t r because demand is 
sourced completely from remanufacturing returns. For a detailed treatment 
of the planning problems discussed in this paper see [3]. 

3 Conclusions 

In this paper we presented a framework to solve the technology choice prob- 
lem with respect to the environmental policy in the presence of a product life 
cycle and an availability cycle for returns. Since we analyzed a quite simplistic 
situation, a number of possibilities exist for further research. A more complex 
demand/return situation can be solved by using general results for control- 
ling the product recovery system as been shown in [4] . Capacity aspects did 
not play a role in our discussion. We assumed that the demand development 
does not depend on the chosen technology. Marketing aspects like consumer 
awareness towards environmental conscious products are neglected. Further, 
competition both on demand as well on the return side are not considered. 
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Abstract In Germany alone, inventories are estimated to be worth of more than 
500 billion €. To manage these inventories, numerous inventory-control policies 
have been developed in the last decades. These inventory-control policies are 
typically derived analytically, which is often complicated and time consuming. For 
many relevant settings, such as complex multi-echelon models, there exist no 
closed-form formulae to describe the optimal solution. Optimal solutions for those 
problems are determined by complex algorithms that require several iteration steps. 
In this paper, we present an alternative approach to derive optimal or near-optimal 
inventory-control policies that are based on Genetic Programming (GP). GP is an 
algorithm related to Genetic Algorithms. It applies the principles of natural 
evolution to solve optimization problems. In this paper, we show how closed-form 
heuristics for a common inventory-control setting with periodic review can be 
found with GP. The advantage of GP is that inventory-control policies can be 
derived empirically without solving complex mathematical models. 

Keywords Inventory - Genetic Programming 



1 Introduction 

In Germany, inventories are estimated to be worth of more than 500 billion €. In 
the last decades, a lot of efforts have been made to reduce these inventories. Today, 
various inventory-control policies are applied that are typically derived 
analytically, which is often complicated and time consuming. Moreover for many 
analytical inventory-control models, there exist no closed-form formulae to 
describe the optimal solution. In that cases, heuristics are applied that often fail to 
find optimal solutions or complex algorithms are used that require several 
calculation steps. With Genetic Programming (GP) however, inventory-control 
policies can be derived in a simple manner. In this paper, we show how closed- 
form heuristics for a common inventory-control setting can be found with GP. GP 
is applied to find closed-form formulae that provide good approximations for 
optimal solutions of the model. These closed-form formulae can be computed in a 
fraction of the time needed by exact methods. For a well-known setting, we 
demonstrate the capability of GP to provide good results. The remainder of this 
paper is divided into three sections. In the next section, we introduce GP. Then, we 
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apply GP to two common inventory-control problems: the newsvendor-model and 
a single-echelon (R,T)-model. In the last section, we sum up the results and 
conclude. 



2 Genetic Programming 

GP applies the principles of natural evolution to optimization problems [4]. It starts 
with an initial generation of artificial individuals that are created randomly. Then, a 
fitness value is assigned to each individual to describe quantitatively how well the 
individual masters its task. Based on these fitness values, the next generation is 
created. GP represents the individuals of each generation as trees. Each tree 
represents one solution to the underlying problem. In our application a tree 
represents a solution to an inventory-control policy. The generic GP algorithm 
consists of the following four steps [5]: 

In the first step of the algorithm, the trees of the initial generation are created 
randomly. Each tree consists of nodes from a function set F and a terminal set T 
that are defined before the start of the algorithm. F contains the functions that can 
be used to construct the trees, such as +, -, * and /. T contains the input parameters 
and state variables of the problem, such as demand rates and inventory levels. T 
also contains a placeholder that represents a real number. If this placeholder is used 
in the tree, a random number is generated and placed at the corresponding location 
of the tree. Figure 1 shows the construction of a tree. The first node of a tree is 
always a function; subsequent nodes are selected from the union F u T. In Figure 1 
the first node of the tree is the multiplication function. Since this function requires 
two arguments, two arcs are attached to the node. Additional nodes are then 
randomly chosen from Fu T and attached to the arcs. For the left arc, the terminal 
L is selected; for the right arc, the terminal A is selected. Because terminals have no 
arguments, the construction of the tree is completed. The tree represents the 
formula L A. Since trees are constructed by choosing functions and terminals 
randomly, a wide variety of trees can be created. 




Fig. 1. Construction of a tree of the initial generation 

In the second step of the algorithm, a fitness value is assigned to each tree. Trees 
that solve the underlying problem well receive a higher fitness value than trees that 
solve the underlying problem poorly. In our application each tree represents an 
inventory-control policy. To evaluate the performance of the policy, we apply it to 
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control an inventory systems and compute the average cost that is achieved under 
this policy. 

In the third step of the algorithm, the trees of the next generation are created by 
applying the genetic operators crossover, mutation, and reproduction to the trees of 
the current population. The probability that a tree is selected for a genetic operation 
depends on its fitness value. Trees with a high fitness value have a higher 
probability of being selected than trees with a low fitness value. Thus, the selection 
favors trees that provide a good solution to the problem. 

In the fourth step of the algorithm, it is checked if a certain number of 
generations has been created. If a pre-defined limit is reached, the algorithm 
terminates and the best tree found during the run is reported as the result of the run. 
Otherwise steps 2 to 4 are repeated. 



3 Applying Genetic Programming to Inventory Control 



3.1 Description of Inventory-Control Models 

Companies hold inventories, among other reasons, to hedge against demand 
uncertainty, and to realize economies of scale. Holding inventory results in 
inventory-holding costs. The inventory-holding cost rate h is used to represent 
these costs. Although inventories result in costs, they can be beneficial. If an order 
causes setup cost k , it is often useful not to order a single unit, but batches of 
several units. Order batching increases inventory-holding cost, but decreases order- 
setup cost. The optimal batch size has to be determined as a trade-off between 
those two cost factors. With deterministic demand, inventories cover future 
demand exactly. With stochastic demand, future demands cannot be forecasted 
precisely. We assume that if customers’ demand cannot be satisfied, customers are 
willing to wait for unsatisfied demand, yielding backlogging costs. The 
backlogging cost rate p exceeds usually the inventory-holding cost rate h. As a 
consequence, companies hold safety stocks to meet stochastic demand with low 
backlogging costs. High safety stocks lead to low backlogging costs, but to high 
inventory-holding cost. Therefore, the optimal safety stock has to be determined. 



3.2 Newsvendor-Model 

To analyze this situation, various models exist [8]. One basic model is the 
newsvendor-model [1]. Demand is stochastic, and orders arrive immediately, i.e., 
the lead time is zero. At the beginning of each period, the inventory level 
(inventory on-hand) is reviewed and an order is placed to raise the inventory level 
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up to S. At the end of each period, inventory-holding cost and backorder-penalty 
cost are charged. 



3.3 (R, T)-Model 

One of the most common inventory-control models for periodic review follows a 
order-up-to policy under periodic review, and is referred to as the (R,7)-model. 
Demand is stochastic, and orders arrive after a lead time of L. In our setting, 
demand follows a Poisson process with mean Ä. The inventory position (inventory 
on-hand plus on-order minus backorder) is reviewed every T periods and each 
period an order is placed to raise the inventory position up to R. The optimal values 
for T and for R have to be determined [2]. There exist algorithms to compute 
optimal values for R and T, but there exists no closed-form formulae. The optimal 
solution algorithms rely on iterative methods, such as the Newton’s method [2] or 
other approaches for convex optimization [6]. 



3.4 Structure of Analysis 



In this section, we will show how GP can be used to generate optimal or near- 
optimal solutions for two commonly used inventory-control models, the 
newsvendor-model and the (R,7)-model. We select these models, because they 
belong to the most frequently used models. First, we only search for one parameter. 
We analyze whether GP is capable to rediscover the optimal solution of the 
newsvendor-model. Next, we simplify the (R,T)-model. We do not search for the 
optimal values for both R and T simultaneously, but we optimize R for a given T. 
The average cost of the solutions found by GP are calculated using analytical 
expressions for the cost function of the (R,T)-model. For this setting, Hadley and 
Whitin [2] derived a approximate cost function, where a closed-form solution to 
compute the optimal value of R exist, for a given T. We compare the solutions 
found by GP with this formula. The results of our experiments indicate that GP is 
able to find the optimal policy of the newsvendor-model and a good heuristic for 
the simplified (R,T)-model. Finally, we use GP to search for two functions, 
representing R and T. We compare the solutions found with a common heuristic 
and a numerical approach. 



3.5 Search for the Optimal Solution of the Newsvendor-Model 



We use the function set F = { +, * /, A , V, 1} and the terminal set T = {h, p, 9 ? }. 

A is the power function. I is the inverse cumulative Poisson distribution. SR is a 
placeholder for randomly generated numerical values in the range [0 .. 10]. 
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The evaluation of an individual is based on its average performance over a 
number of training cases. To evaluate an individual, we compute its cost by 
applying 

S 00 

TC(S)= h] (S - x)f(x)dx + p\ (x-S)f(x)dx (1) 

0 s 

To train the algorithm, we apply each individual to a set of 100 training cases 
that are based on randomly generated combinations of the parameters A>h, p, with A 
[0.5 .. 5], h [1 .. 50], p [OAh .. 25 ft]. For each parameter combination, the optimal 
value of S can be calculated as follows 

U-?-r)=S* (2) 

p + h 

For each training case, we can compute the cost of the optimal solution. Then, 
we compare the optimal cost with the cost of the individual for each training case 
and sum up the deviations. The higher the cost of the individual in comparison to 
the optimal cost, the lower the fitness of the individual and therefore, the change to 
be selected for genetic operations. 

We conduct 50 runs of 30 generations each, with population sizes of 1,000, 
2,500, 5,000, and 10,000 individuals to analyse the capability of GP to find this 
formula. The percentage of hits, i.e., the percentage of runs where GP finds the 
optimal solution, increases with an increase of the population size. In all 
experiments, we apply a crossover probability of 90%, a mutation probability of 
5%, and a reproduction probability of 5%. Figure 2 reports the percentage of runs 
that find the optimal solution. 



Percentage of hits 




Population size 



Fig. 2. Results of search for S 
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3.6 Search for R 

We use the function set F = { +, * /, A , V, I, Cl} and the terminal set T = {/*, p, 

k, T y R}. Cl is the complementary of the inverse cumulative Poisson distribution. 
The evaluation of an individual is based on its average performance over a number 
of training cases. To evaluate an individual, we compute its cost by an adoption of 
Rao’s [6] exact cost function for a number of training cases. 

k 1 L+T 

TC(R,T)=- + - J G(R, t)dt, with (3) 

T T l 

G(R, t) = HE pi- X(0) + jj+- pE^X(t)- #) + | (4) 

X(t) is the cumulative demand distribution. To train the algorithm, we apply 
each individual to a set of 100 training cases that are based on randomly generated 
combinations of the parameters A, L, T, h, p, k, with the ranges A [0.5 .. 5], L [0 .. 
3], ä [1 ..50],/? [0.1/* .. 25/*], k [1 .. 1000]. 

For each training case, we can compute the cost of the optimal solution. Then, 
we compare the optimal cost with the cost of the individual for each training case 
and sum up the deviations. The higher the cost of the individual in comparison to 
the optimal cost, the lower the fitness of the individual and therefore, the change to 
be selected for further generations. 

After 724 generations with a population size of 10.000, GP found a solution 
with average cost 0.6% above the optimal solution for the training cases. R can be 
computed by solving 

J9li 

?-+sf9Ji 

h 

To test the performance of the solution found by GP, we compare its cost with 
the cost of the solution found by Hadley and Whitin [2] on a basis of 1000 test 
cases. Hadley and Whitin developed a approximate cost function, where the 
optimal R can be computed for a given T by solving 




Based on a test bed of 1000 test cases, the average cost of the GP solution was 
0.8% above optimality, whereas the average cost of the solution of Hadley and 
Whitin was 3.7% above optimality. 
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3.7 Search for R and T 



We next are to search for both R and T simultaneously. Each GP tree consists of 
two subtrees. One subtree represents R , the other one T. The parameters X and L 
are added to the terminal set. 



We apply each individual to 100 training cases that are based on randomly 
generated combinations of the parameters X [0.5 .. 5], L [0 .. 3], h [1 .. 50], p [0.1/* 
.. 25/*], k [1 .. 1000]. In this phase, T is not predefined, but has to be determined by 
GP. We compute the optimal solutions and compare their cost with the cost of the 
inventory-control policies created by GP. After more than 1000 generations, GP 
found the following solution, with average cost 7.37% above optimality. 
f ^ 



Cl 



and T = 



P + A 



2k + HX 
hX 



-** + 7.18 



(7) 



To test, whether GP has found a general solution, we compare it with solutions 
found by other approaches. We selected two methods: two heuristic approaches 
and a numerical, optimal one. 

The first heuristic is suggested by Tempelmeier [7] to compute T. For this T, R 
is computed using Hadley and Whitin’ s formula [2]. T is calculated using the EOQ 
formula [3]. 



EOQ 

X 



2kX 

V h 



X 



( 8 ) 



The second heuristic computes T using the EOQ formula. Then, R is computes 
by applying the optimal solution of the newsvendor-model. The optimal approach 
uses Newton’s method to calculate the optimal values for R and T. 

We compare the performance of the heuristics using a test bed of 1000 cases. 
For this test bed, the optimal solutions are calculated with Newton’s method. The 
Genetic Programming solution was on average 4.47% above optimality, whereas 
the heuristic of Tempelmeier was on average 15.40% above optimality. The 
heuristic based on the solution to the modified newsvendor model was on average 
47.47% above optimality. Based on this test bed of 1000 cases, we conclude that 
Genetic Programming finds a solution in closed-form that is superior to commonly 
used heuristics for the used ranges of parameters. 
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4 Conclusions 

Inventory-control is a broad field of research. Numerous models have been 
developed to optimize inventory systems. For the simple ones, such as the 
newsvendor-model, optimal solutions have been found, for the complex ones, 
heuristics have been developed. In this paper, we show how closed-form heuristics 
can be found with Genetic Programming. For a simple model, the newsvendor- 
model, we rediscover the optimal solution. For the (R,T)-model, we find heuristics 
that provide a good solution quality with a low complexity. As a result of our 
work, we can conclude that Genetic Programming is a powerful tool for deriving 
inventory-control policies. However, there is no guarantee that inventory-control 
policies found by GP perform decently for parameter combinations outside of the 
tested ranges. 



References 



1. Arrow, K.A., Harris, T.E., Marschak, T. 1951. Optimal inventory Policy. 
Econometrica 19, 250-272. 

2. Hadley, G., Whitin, T. 1963. Analysis of Inventory Systems. Englewood Cliffs, 
NY, Prentice-Hall. 

3. Harris, F. W. 1915. Operations and Costs. Factory Management Series, 
Chicago. 

4. Koza, J. R. 1992. Genetic Programming - On the programming of computers 
by means of natural selection. MIT Press, Cambridge. 

5. Koza, J. R., Bennett, F. H., Andre, D., Keane, M. A. 1999. Genetic 
Programming III - Darwinian Invention and Problem Solving. Kaufmann, San 
Francisco. 

6. Rao, U. S. 2003. Properties of the Periodic Review (R,T) Inventory Control 
Policy for Stationary. Stochastic Demand, Manufacturing & Service Operations 
Management 5(1), 37-53. 

7. Tempelmeier, H. 2003. Material-Logistik: Modelle für die Produktionsplanung 
und -Steuerung und das Supply Chain Management. Springer, Berlin. 

8. Zipkin, P. H. 2000. Foundations of inventory management. McGraw-Hill, 
Boston. 




Dynamic Multi-Commodity Facility Location: 
A Mathematical Modeling Framework for 
Strategic Supply Chain Planning 



M. T. Melo 1 , S. Nickel 1,2 , and F. Saldanha da Gama 3 

1 Department of Optimization, Fraunhofer Institute for Industrial Mathematics 
(ITWM), D 67663 Kaiserslautern, Germany 

2 Chair of Operations Research and Logistics, Saarland University, 

D 66041 Saarbrücken, Germany 

3 Department of Statistics and Operations Research, University of Lisbon, 

P 1749-016 Lisbon, Portugal 



Abstract. We propose a mathematical modeling framework for supply chain net- 
work design which captures many aspects of practical problems that have not re- 
ceived adequate attention in the literature. The aspects considered include: dy- 
namic planning horizon, generic supply chain structure, inventory and distribution 
opportunities for goods, facility configuration, budget constraints, and storage lim- 
itations. Moreover, the gradual relocation of facilities over the planning horizon is 
considered. A generic mathematical programming model is described in detail and 
several extensions are discussed. 



1 Introduction 

The design of supply chain networks is a complex decision making process. 
Typical decisions involve determining the location, size and the number of 
new facilities to operate as well as the flow of goods through the supply 
chain network to satisfy known demands. Facility location and configuration 
of production-distribution networks have been studied for many years (see 
Bender et al [1] for a review of models, company-specific case studies, and 
decision support systems). Important issues such as the external supply of 
commodities, inventory opportunities for goods, storage limitations, avail- 
ability of capital for investments, and relocation, expansion or reduction of 
capacities have been treated individually by several authors. However, there 
is evidence that companies wish them all to be explicitly included in the 
design of their supply chain networks (see e.g., Bender et al [1] and Kalc- 
sics et al. [2]). Clearly, network design is strongly affected by the simultaneous 
consideration of these and other practical needs. One observes a lack of rea- 
sonably simple, yet comprehensive, models which illustrate the effect of such 
factors on network configuration decisions. This paper attempts to fill this 
gap. Our main contribution is to provide a mathematical modeling framework 
for assisting decision-makers in the design of their supply chain networks. In 
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the next section we describe the problem at stake. A mixed integer linear pro- 
gramming (MIP) formulation is introduced in Section 3. Finally, Section 4 
briefly discusses several model extensions and directions for future research. 

2 Dynamic Facility Relocation 

We assume that a company is considering gradually relocating part or all of 
the capacity of some of its existing facilities to new locations during a certain 
time horizon. Prior to the planning project, a set of candidate sites has been 
selected where new facilities can be established. Both the existing capaci- 
ties as well as the capacities of the prospective sites are known in advance. 
To illustrate the conditions under which capacity may be transferred from 
existing locations to new sites, consider the situation depicted in Figure 1. 
At the end of a given period, say t — 1, the company operates facilities ii, 



Period t — 1 



Existing facilities Potential new facilities 



A Ü* 



Period t 



Existing facilities New facilities 



A Ö h 



Fig. 1. The effect of capacity relocation 



i2 and is- Potential sites for setting up new facilities are denoted by j i, j2 
and js - It is assumed that if capacity is to be shifted then this will occur at 
the beginning of period t, and will have a relatively short duration compared 
to the period length. On the right-hand side of Figure 1 a possible scenario 
for capacity shifting is displayed. At the beginning of period t new facilities 
will be operating in all three potential sites. The capacity of the existing 
facility i\ is totally distributed among the sites ji, j' 2 , and js- As a result, 
facility i\ will neither operate in period t nor in any subsequent period. Thus, 
we assume that the facility is closed at the end of period t — 1, and its total 
capacity is moved to the new sites at the beginning of period t . Part of the 
capacity of the existing facility %2 is transferred to the new site - Facility %2 
remains in operation but with reduced capacity. Note that the new facility j 2 
has attained its maximum capacity, while facilities j\ and js can still have 
their capacity extended in later periods. Capacities transferred to the new 
facilities cannot be removed in later periods, that is, capacity reductions are 
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only allowed at existing facilities. Finally, the existing facility is retains all 
its capacity. 

Relocation decisions are constrained by budget limitations. We assume 
that in each time period a given budget is available for investing not only 
in capacity transfers, but also in the setup of new facilities and shutdown of 
existing facilities. Relocation costs incurred by capacity shifts are assumed 
to depend on the amount moved from an existing facility to a new site, and 
account, for example, for workforce and equipment transfers. Since the setup 
of a new facility is usually a time-consuming process, we assume that it takes 
place in the period immediately preceding the start-up of operations. Hence, 
if a new facility starts operating in some period £, fixed costs are charged 
with respect to its setup in period t — 1. On the other hand, when an existing 
facility ceases operating at the end of some period t, we assume that shutdown 
costs are charged in the following period. Any capital available in a period, 
but not invested then, is subject to an interest rate and the returned value 
can be used in subsequent periods. 

Using the available investment capital in each period and considering the 
capacity limitations, our problem consists in determining the time periods 
during which the capacity of existing facilities should be reduced and when 
the transition to newly established facilities should be made. Capacity shifts 
must be carried out in such a way that supply chain activities are not dis- 
rupted. The latter include the provision of materials from external suppliers, 
the transportation of goods through the network and the storage of products 
at facilities. These activities are to be planned so as to minimize system- 
wide costs given that demands must be satisfied. Finally, in contrast to many 
well-known location models, we neither impose an echelon structure on the 
supply chain network nor restrict the distribution channels for shipping the 
goods. In other words, any type of facility is supported by our approach and 
commodities can be transported between any pair of facilities. 

3 Problem Formulation 

Index sets 

C : set of facilities 
<S : set of selectable facilities, <S C C 
S c : set of selectable existing facilities, S c C S 
S° : set of potential sites for establishing new facilities, S° C S 
V : set of product types 
T : set of periods with | T | = n 

The set C contains all types of facilities. These are categorized in so-called 
selectable and non- selectable facilities. Selectable facilities form the set S and 
include existing facilities ( S c ) as well as potential sites for establishing new 
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facilities ( S ° ). At the beginning of the planning horizon, all the facilities 
in the set S c are operating. Afterwards, capacity can be shifted from these 
facilities to new facilities located at the sites in S°. Note that <S c n<S° = 0 and 
S c U S° = S. The second category of facilities, the so-called non-selectable 
group, forms the set £\S and includes all facilities that exist at the beginning 
of the planning project and which will remain in operation. Examples of 
such facilities include plants and warehouses that should continue supporting 
supply chain activities, that is, are not subject to relocation decisions. Non- 
selectable facilities may also have demand requirements, that is, they may 
correspond to customers. 

Costs 

PCl p : variable cost of purchasing one unit of product p eV from an 
external supplier by facility £ G £ in period t G T 
TCj ^ / p : variable cost of shipping one unit of product p G V from facility 
£ G C to facility £' G £ (£ ^ £ f ) in period t G T 
IC \ : variable inventory carrying cost per unit on hand of product 

p G V in facility £ G C at the end of period t G T 
MC\ j : unit variable cost of moving capacity from the existing facility 

i G S c to a new facility established at site j G S° at the beginning 
of period t G T \ {1} 

OC\ : fixed cost of operating facility £ G C in period t G T 
SCj : fixed cost charged in period t G T \ {1} for having shut down 
the existing facility i G S c at the end of period t — 1 
FC f j : fixed setup cost charged in period t £ T \ {n} when a new facility 
established at site j G S° starts its operation at the beginning of 
period t + 1 

Parameters 

k\ : maximum capacity of facility £ G C in period t G T 
K\ : minimum required throughput at the selectable facility £ G S in 
period t G T 

ßt, p : unit capacity consumption factor of product p G V at facility £ G C 
H^ p : stock of product p G V at facility £ G C at the beginning of the 
planning horizon (observe that H^ p = 0 for every £ G S°) 

D\ p : external demand of product p G V at facility £ € £ in period t gT 
a 1 : unit return factor on capital not invested in period t G T \ {n}, that 
is, a 1 — 1 + /?*/!. 00 with ß l denoting the interest rate in period t 
B l : available budget in period t G T 
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Since each existing selectable facility may have its capacity transferred to 
one or more new facilities, it is assumed that its maximum capacity is non- 
increasing during the planning horizon, that is, k\ > K * +1 for every i G S c 
and t G T \ {n}. Without loss of generality, it is assumed that .fQ denotes 
the actual size of facility i G <S C at the beginning of the planning horizon. 
The above condition permits to impose capacity transfers in specific periods 
or even complete shutdowns. Similarly, potential new facilities have non- 
decreasing capacities, that is, < if*-" 1 " 1 for every j G S° and t E T\ {n}. 

Clearly, at the beginning of the planning project we have K j = 0 for every 
new site j E S° . 

Decision variables 

b\ p = amount of product p E V purchased from an outside supplier by 
facility £ G Cm period t gT 

x\ £ , p = amount of product p GV shipped from facility £ G C to facility 
£ f G C {£ ^ £') in period t gT 

y\ p = amount of product p GV held in stock in facility £ G C at the end 
of period t G T U {0} (observe that y\ p = H^ p ) 
z\ j = amount of capacity shifted from the existing facility i G S c to a 
newly established facility at site j G <S°, at the beginning of 
period t gT 

= capital not invested in period t gT 

_ f 1 if the selectable facility £ G S is operated during period t G T 
£ 0 otherwise 

In view of the assumptions made on the time points for paying fixed facility 
costs, it follows that a new facility can never operate in the first period since 
that would force the company to invest in its setup before the beginning of 
the planning horizon. Similarly, an existing facility cannot be closed at the 
end of the last period since the corresponding fixed shutdown costs would be 
charged in a period beyond the planning horizon. Hence, zjj = 0 for i G S c 
and j G S° , Sj = 1 for i G <S C , and = 0 for j G S°. 

Assuming that all parameters are non-negative our MIP formulation is as 
follows. 

MIN £ E TC, v.p4r, P 

ter tec P ev ter tec t f ec\{t} per 

+EEE /C ipylp+EE 0C ^ + E E oc l w 

ter tec P ev ter tes tertec\s 

s. t. 

b\, P + E x e’,e,p + v\,p = 

t'£C\{l} 
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Di P + E x £, £' iP + y£, P i £ £ £, p eV,t eT 
£'ec\{£} 

^-EE zlj<Klsl, i e S c ,t eT 
r=ijes° 

EE^'^4 ie<5°,ier 

r= 1 t€<S c 
t 

EE e < > i G <5 C > t € T 

r=i je<s° 



( 2 ) 

(3) 

(4) 

(5) 



E ^*’P ( b + vlp 1 

per \ eec\{i} 

<^-EE<i- ieS c ,teT 

r=l j€S° 



( 6 ) 



E f^j’P ( b lp + E x h,p + yip 1 

p€V \ eec\{j } 

^EE z i,ji J £ t ^ ^ 



r=l i£<S c 



(7) 



E ^ b ip + E *5'- 

p€P \ e'ec\{e} 



’V) <K\, i€C\S,teT( 8) 



E^ ^,p + E x i',«,p + 2/lp 1 >E*e$e, i&S,teT (9) 



\ £'£C\{£} ) 

<5|><5J +1 , ie5 c ,t6T\{n} (10) 

<5j<S* + \ j€<SVeT\{n} (11) 

2 ^ + £* = B 1 (12) 

jes° 

E E MC L- + E (C 1 - € + E ^ (^ t+1 - 3) 

iE«S c j€<S° iG«S c je«S° 

+ ^B'+a*- 1 ^" 1 , teT\{l,n} ( 13 ) 

53 53 mci 3 z% + 53 sc? (sr 1 - s?) + e 

ies c jes° ies c 

= B n +a n ~ 1 C~ 1 (14) 



b\, p > 0, y\ p > 0, x\^ fp >0, 1,1* G C, p eV, t eT (15) 
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zj tj >0, ie S c , j eS°,teT 
? > 0, teT 
5g G {0, 1 j-, £ G <S, t G 'T 



(16) 

(17) 

(18) 



In the above formulation, the objective is to operate the supply chain 
network at minimum cost as stated by (1). The costs to minimize include 
supply costs, transportation costs between facilities, inventory holding costs, 
and fixed facility operating costs. 

Constraints (2) are the usual flow conservation conditions which must 
hold for each product, facility and period. Inequalities (3)-(5) ensure that 
feasible capacity relocations take place during the planning horizon. Note 
that constraints (3) also guarantee that only operating existing facilities can 
have their capacity moved to new facilities. Furthermore, constraints (4) also 
impose that by period t a new facility has been constructed at site j in order 
for a capacity relocation to take place. Constraints (5) (with e a sufficiently 
small positive number) state that if the capacity of an existing facility has 
been completely transferred then the facility has to be closed. The combi- 
nation of (3) and (5) ensures that if an existing facility does not operate 
in a given period then its entire capacity was removed in one of the previ- 
ous periods. Moreover, by (5) no more capacity can be shifted out of such 
a facility than the one available at the beginning of the planning horizon. 
Inequalities (6)-(8) impose the capacity constraints. Observe that inequali- 
ties (6) also prevent any supply chain activities from taking place in existing 
facilities whose capacity has been totally relocated. Inequalities (9) state that 
it is only worth to operate a selectable facility if its throughput is above a 
meaningful level. Constraints (10) and (11) allow the configuration of each se- 
lectable facility to change at most once. Hence, if an existing facility is closed, 
it cannot be re-opened. Similarly, when a new facility is established it will re- 
main in operation until the end of the planning horizon. Conditions (12)-(14) 
are budget constraints. In the first period, the allowed investments regard set- 
ting up new facilities that will start operating at the beginning of the second 
period (cf. (12)). In each one of the following periods t G T \ {l,n}, the 
available capital may cover capacity transfers, the costs incurred by closing 
existing facilities at the end of period t — 1, and setups of new facilities that 
start operating at the beginning of period t + 1 (cf. (13)). In the last period n, 
the allowed investments concern capacity transfers as well as shutdowns of fa- 
cilities that have ceased operating at the end of period n — 1 (cf. (14)). Finally, 
constraints (15)— (18) represent non- negativity and integrality conditions. 

The above formulation describes a large scale MIP problem. Using com- 
mercially available mathematical programming software, Melo et al [3] have 
shown that problems of moderate size (with up to | T | = 5, | £ | = 185, 

| <S C | = 10, | S° | = 20, | S | = 30, and | V | = 10) can be solved optimally in 
less than 5 hours (using a Pentium III, 2.6 GHz, 2 GB RAM). 
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4 Extensions and Outlook 

When a company anticipates a growth in its sales volumes, it will need to 
expand its supply chain network to respond to increasing demand patterns. 
Expansion plans may result in extending the capacity of existing facilities 
and/or establishing additional facilities. Although in our model the total ca- 
pacity available at the beginning of the planning project does not change over 
the time horizon, it is relatively easy to extend it to an expansion scenario. 
We consider a fictitious facility , denoted by io , which concentrates the total 
additional capacity, K io , required to cope with increasing demands. This fa- 
cility has a similar status to that of the selectable facilities in <S C , although it 
cannot satisfy any demands. Its capacity can be shifted to both existing and 
new facilities. As a result, either an existing facility will have its capacity ex- 
panded or it will be (partly) relocated to one or more new sites. Regarding the 
new facilities, these can receive capacity not only from existing (selectable) 
facilities, but also from the fictitious facility io. As in the base model, new 
facilities cannot be downgraded. 

The opposite scenario, i.e. capacity reduction, can also easily be incor- 
porated in our model. In this case, a fictitious facility , denoted by jo , is 
considered which can be established with all excess capacity from existing 
facilities. This implies that jo has a similar status to that of the potential 
new facilities in S°, but cannot satisfy any demand requirements. 

Another simple extension of our model is to consider modular capacity 
transfers instead of continuous shifts. Melo et al. [3] have shown that the base 
model along with the above extensions includes many well known dynamic 
facility location problems in which network design decisions are restricted to 
opening new facilities and closing existing ones. On the other hand, it gener- 
alizes many of the models proposed in the literature (see Melo et al. [3] for 
an extensive comparison). Currently, focus is being given to the development 
of heuristic procedures based on variable neighborhood search to decide on 
the facilities that should operate in each period. Preliminary results indicate 
that on average feasible solutions can be obtained within 2% of the optimum. 
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Zusammenfassung Bei der Leistungsabstimmung von Produktionslinien in der 
Elektronikmontage (Leiterplattenbestückung) sind die zu bestückenden Bauele- 
mente auf die verschiedenen Automaten innerhalb der Linie aufzuteilen. Hierbei 
sind sowohl die begrenzten Magazinkapazitäten als auch die technischer Restrik- 
tionen der Automaten zu beachten. Gleichzeitig sind unter Beachtung einer mögli- 
chen Mehrfachaufrüstung ausgewählter Bauelementtypen die Bestückungsopera- 
tionen auf die verschiedenen Automaten innerhalb der Linie aufzuteilen. Ziel ist 
der Belastungsausgleich zwischen den Automaten. Zur Lösung dieser komplexen 
Entscheidungsprobleme wird eine effiziente Heuristik vorgeschlagen. 



1. Einleitung 

Hochautomatisierten Montagelinien kommt bei der Großserien- und Massenpro- 
duktion von elektronischen Baugruppen (Leiterplattenbestückung) eine herausra- 
gende Bedeutung zu. Hierbei werden oft nur ein einziger Leiterplattentyp oder ei- 
ne begrenzte Anzahl verwandter Leiterplattentypen in einer Linie montiert. Das zu 
bestückende Bauelementespektrum erfordert zumeist unterschiedliche Automaten- 
typen. Nur so kann die geforderte Flexibilität und Produktivität erreicht werden. 
Darüber hinaus sind weitere Einrichtungen in die Montagelinie integriert. Von 
entscheidender Bedeutung für die Taktzeit und damit für die gesamte Produktivität 
der Montagelinie sind die zur Steuerung der Bestückungsprozesse der einzelnen 
Automaten sowie der Leistungsabstimmung der Linie eingesetzten Algorithmen. 

Während bei der Kleinserienmontage, die durch eine hohe Vielfalt unter- 
schiedlicher Leiterplattentypen geprägt ist, die Optimierung der Auftragsfreigabe 
und Auftragsreihenfolge im Vordergrund steht (vgl. [7], [8], [11]), sind bei Groß- 
serien- und Massenproduktion die Optimierung der Arbeitsweise der einzelnen 
Automaten und darüber hinaus die Leistungsabstimmung innerhalb einer Monta- 
gelinie von ausschlaggebender Bedeutung. 

Im Wesentlichen enthält eine Montagelinie die folgenden Einrichtungen: 

• verschiedene Arten von Bestückungsautomaten, 

• Peripheriegeräte (z.B. Lotpastendrucker, Klebestation, Lötofen, Reinigungssta- 
tion), 
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• Materialhandlinggeräte (z.B. Leiterplattenzufuhr, Wendestationen, Transport- 
bänder, Puffer), 

• Testeinrichtungen (z.B. Beschaffenheitsprüfung, Sichtprüfung, Funktionsprü- 
fung) sowie u.U. eine Nacharbeitsstation. 

Abb. 1 zeigt beispielhaft den Aufbau einer Montaglinie bei einem Hersteller 
von Telematiksystemen. Als erstes wird mit Hilfe eines Siebdruckverfahrens Lot- 
paste an den Bestückungspositionen aufgetragen. Die Lotpaste besteht aus einer 
Mischung von Lotzinn, Klebstoff und Flussmittel und dient dazu, die Bauelemente 
auf der Leiterplatte an ihren vorgesehenen Positionen zu fixieren. Durch verschie- 
dene Bestückungsautomaten werden dann sog. oberflächenmontierte Bauelemente 
(SMDs, surface mount devices) bestückt. Anschließend werden mit Hilfe eines 
Lötofens durch Schmelzen des Lotzinns die Bauelemente mit der Leiterplatte e- 
lektrisch verbunden. Die Leiterplatten durchlaufen dann noch weitere Bestü- 
ckungsautomaten, in denen Sonderformen von Bauelementen (u.a. Axial- und Ra- 
dialkomponenten) montiert werden. Nach Wenden der Leiterplatte erfolgt ein 
weiterer Durchlauf durch die Montaglinie zur Bestückung von oberflächenmon- 
tierten Bauelementen auf der Rückseite der Leiterplatte. 




Axial- und Radialbestückung 



Abb. 1. Beispiel einer Montagelinie zur Bestückung von Leiterplatten 



2. Problemstellung 

Bei der Leistungsabstimmung von Montagelinien stehen zwei eng miteinander 
verknüpfte Probleme im Vordergrund, nämlich die Aufteilung der zu bestücken- 
den Bauelemente auf die verschiedenen Automaten innerhalb der Linie unter Be- 
achtung der begrenzten Magazinkapazitäten und der jeweiligen technischer Re- 
striktionen der Automaten sowie die Zuordnung der Bestückungsoperationen auf 
die verschiedenen Automaten. Die Zielsetzung besteht darin, einen Belastungs- 
ausgleich zwischen den Automaten innerhalb der Linie zu erreichen. Die meisten 
industriellen Montagelinien sind so aufgebaut, dass die verschiedenen Hilfsein- 
richtungen (z.B. Lötofen) sich nicht als Engpass erweisen und daher bei der Leis- 
tungsabstimmung i.d.R. vernachlässigt werden können. 
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Im Gegensatz zu den aus der wissenschaftlichen Literatur bekannten klassi- 
schen Verfahren zur Leistungsabstimmung bei Fließproduktion ist in der Elektro- 
nikmontage die spezifische Arbeitsweise der eingesetzten Automaten zu beachten. 
Welche Erhöhung der Bestückzeit durch die Zuordnung eines Bestückungs Vor- 
gangs bzw. des zugehörigen Bauelements zu einem Automaten eintritt, lässt sich 
ohne eine exakte Analyse der kinematischen Abläufe und ohne Berücksichtigung 
der Anordnung der Bauelementezuführungen im Magazin des Automaten und der 
zur Automatensteuerung verwendeten Algorithmen nicht zuverlässig ermitteln 
(vgl. [4]). 

So werden für die hochpräzise Bestückung komplexer Bauelemente sog. Pick 
&Place- Automaten eingesetzt, bei denen die Bauelemente jeweils einzeln durch 
einen frei beweglichen Roboterarm aus dem Magazin entnommen und anschlie- 
ßend auf der Leiterplatte aufgesetzt werden. Eine deutlich höhere Bestückungs- 
leistung weisen Collect&Place-Automaten auf, bei denen der Roboterarm mit ei- 
nem Revolver zur Aufnahme mehrerer Bauelemente ausgestattet ist, sowie Chip- 
Shooter, bei denen der Transfer der Bauelemente vom Magazin zur Leiterplatte 
durch ein rotierendes Karussell erfolgt. Schließlich wurden für die Bestückung 
von Standardbauelementen modulare Bestückungsautomaten entwickelt, bei de- 
nen verschiedene Pick&Place- oder Collect&Place-Module wie bei einer Trans- 
ferstrasse sequentiell innerhalb des Automaten angeordnet sind. Diese Automaten 
erreichen die mit Abstand höchste Bestückungsleistung. Aus technischen Gründen 
können Bauelemente nur auf bestimmten Automaten bestückt werden. Daher ist 
eine Linie zumeist aus unterschiedlichen Automatentypen aufgebaut. 

Welche Bestückungsleistung tatsächlich erreicht werden kann, hängt nicht nur 
von dem jeweiligen Automatentyp ab, sondern auch wesentlich von der gewählten 
Zuordnung der Bauelementtypen zu den Positionen im Magazin des Automaten 
sowie von der Reihenfolge der Bestückungsoperationen. Hierbei handelt es sich 
um komplexe Optimierungsprobleme, für die keine exakten Lösungsverfahren zur 
Verfügung stehen. In die Leistungsabstimmung von Montagelinien sind diese Ge- 
sichtspunkte der Automatensteuerung zu integrieren. Sowohl die aus der wissen- 
schaftlichen Literatur bekannten Ansätze als auch die im kommerziellen Soft- 
wareangebot enthaltenen Algorithmen ignorieren diese Anforderung, indem sie 
von gegebenen Bestückzeiten und anderen vereinfachenden Annahmen ausgehen 
(vgl. z.B. [9], [10], [11], [12]). Andere Autoren beschränken sich auf die Analyse 
von Tandemkonfigurationen (z.B. [2]). 



3. Mathematische Modellformulierung 

Im Mittelpunkt der Leistungsabstimmung von Montagelinien steht der Belastungs- 
ausgleich zwischen den einzelnen Automaten. Hierzu wird im Folgenden ein ma- 
thematisches Optimierungsproblem formuliert, wobei von der vereinfachenden 
Annahme ausgegangen wird, dass die Bestückungszeit eines Bauelements auf den 
Automaten gegeben ist. Wie im Vorabschnitt erläutert, hängt diese Bestückungs- 
zeit von der Anordnung der Bauelementtypen im Magazin des Automaten und von 
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der Reihenfolge der Bestückungsoperationen ab. Die folgende Modellformulie- 
rung erfasst daher lediglich das Kernproblem der Leistungsabstimmung für einen 
gegebenen Leiterplattentyp. Eine effiziente Heuristik zur Berücksichtigung des 
Einflusses der Automatensteuerung wird im nächsten Abschnitt vorgestellt. 

Indizes, Indexmengen 

i € I Bauelemente (Bestückungsoperationen) 
j e J Automaten in der Montagelinie 

i e I j Bauelemente, die von Automat j bestückt werden können 
t e Tj Bauelementtypen, die von Automat j bestückt werden können 

Parameter 

M j Magazinkapazität von Automat j (maximale Anzahl an Bauelement- 

typen) 

t(i) Bauelementtyp, der in Operation i bestückt wird 

Cij Bestückungszeit für Bauelement i auf Automat j 

Entscheidungsvariablen 

x t j = 1, falls Bauelement i von Automat j bestückt wird (= 0, sonst) 

yj t - 1, falls Bauelementtyp t auf Automat j gerüstet wird (= 0, sonst) 

w maximale Belastung eines Automaten in der Montagelinie 

Modellformulierung 

min w (1) 



( 2 ) 



(3) 



(4) 



unter den Nebenbedingungen 
Maximale Arbeitslast der Automaten 



w 



iel j 






Magazinkapazität 

teT j 

Magazinrüstung 

x u * yj,td) 

Bestückungsoperationen 



Y, x a =1 



jeJ 



jeJ 



j eJ,i<= Ij 



i e / 



jeJ:i e I j 



(5) 
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Wertebereiche 



Xij € {0,1} 


j eJ,ie Ij 


(6) 


yjt e {°*i} 


j € J ,t sTj 


(7) 


w> 0 




(8) 



Zu minimieren ist die Taktzeit der Linie, die durch das Maximum der Arbeitslast 
aller Automaten der Linie bestimmt wird. Dies erfolgt durch die Zielfunktion (1) 
in Verbindung mit Nebenbedingung (2). Die beschränkte Kapazität der Bauele- 
mentemagazine der einzelnen Automaten wird durch (3) erfasst. Nebenbedingung 

(4) besagt, dass ein bestimmtes Bauelement von einem Automaten nur dann be- 
stückt werden kann, wenn der zugehörige Bauelementtyp auf dem betreffenden 
Automaten gerüstet ist. (Bauelement i ist hierbei vom Typ t(i)). Nebenbedingung 

(5) stellt sicher, dass jedes Bauelement genau einmal bestückt wird. In (6) bis (8) 
werden die Wertebereiche der Entscheidungsvariablen definiert. 

Das Modell (1) bis (8) stellt ein binäres Optimierungsmodell mit einer zusätzli- 
chen kontinuierlichen Variablen dar, das für realistische Problemgrößen mehrere 
Tausend Variablen und Nebenbedingungen enthält. Die exakte Lösung des Mo- 
dells wäre aber dennoch als Näherungslösung des realen Problems der Leistungs- 
abstimmung anzusehen, da - wie oben erwähnt - die Bestückungszeiten als gege- 
ben angenommen und nicht etwa durch eine explizite Optimierung der Automa- 
tensteuerung gewonnen werden. 



4. Heuristisches Lösungsverfahren 

Die Leistungsabstimmung der gesamten Montagelinie unter Berücksichtigung der 
Entscheidungen über die Zuordnung der Bauelementtypen zu den Magazinpositi- 
onen der Automaten und über die Reihenfolge der Bestückungsoperationen er- 
weist sich als äußerst komplexes Optimierungsproblem, für das keine exakten Lö- 
sungsverfahren bekannt sind. Daher wird im Folgenden eine neuartige, effiziente 
Heuristik vorgeschlagen. Dieser Ansatz unterscheidet sich von den aus der Litera- 
tur bekannten Ansätzen durch die Einbindung der Automatenoptimierung mit ei- 
nem sehr hohen Genauigkeitsgrad. Hierzu wurde basierend auf den Erfahrungen 
mit der Optimierung modularer Bestückungsautomaten (vgl. [6]) ein mehrstufiger 
Algorithmus entwickelt, der den Belastungsausgleich zwischen den Automaten 
der Linie und die Optimierung auf Automatenebene integriert. 

Im Einzelnen gehen wir von folgenden Annahmen aus: 

• Die Arbeitsausführung innerhalb der Linie ist getaktet, wobei sich die Taktzeit 
aus der maximalen zeitlichen Belastung der einzelnen Automaten ergibt. 

• Die Zuführeinrichtungen (Feeder) für die verschiedenen Bauelementtypen be- 
legen jeweils nur einen Magazinplatz. 

• Ein Bauelementtyp kann an mehreren Automaten gerüstet werden. 
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• Für jeden Bauelementtyp ist vorgegeben, auf welchen Automaten er bestückt 
werden kann. 

• Innerhalb einer Linie gibt es unterschiedliche Automatentypen, die sich hin- 
sichtlich des zulässigen Spektrums von Bauelementtypen, der Magazinkapazi- 
tät, der Bestückungsgeschwindigkeit und insbesondere der kinematischen Ei- 
genschaften unterscheiden. 

Die Intention des heuristischen Lösungsverfahrens besteht darin, die Bestü- 
ckungszeiten der Automaten nicht als gegeben anzunehmen, sondern diese Größen 
aus der Automatensteuerung unter Berücksichtigung der kinematischen Eigen- 
schaften der Automaten abzuleiten. Das Verfahren durchläuft drei Stufen. Zur Er- 
läuterung des Verfahrens wird beispielhaft eine Leiterplatte betrachtet, die mit 298 
Bauelementen und insgesamt 43 Bauelementtypen zu bestücken ist. Die Montage- 
linie besteht aus je einem Pick&Place- und Collect&Place- Automaten sowie aus 
einem Chip-Shooter und einem modularen Bestückungsautomaten. 

Stufe I: Bestimmung von Bestückungsfaktoren. Zunächst wird für den be- 
trachteten Leiterplattentyp die effektive Bestückungsleistung der verschiedenen 
Automaten unter Berücksichtigung ihrer jeweiligen kinematischen Eigenschaften 
bestimmt. Hierzu wird hypothetisch davon ausgegangen, dass jeder Automat in 
der Montagelinie sämtliche Bestückungsoperationen ausführt. Somit werden die 
Restriktionen (3) bis (5), d.h. insbesondere auch die beschränkten Magazinkapazi- 
tät der Automaten, zunächst vernachlässigt. Um die Bestückungszeiten auf den 
einzelnen Automaten realistisch zu ermitteln, werden die Magazinbelegung und 
die Bestückungssequenzen mit Hilfe spezifischer Verfahren zur Automatensteue- 
rung bestimmt. Hierzu wird für Pick&Place- und Collect&Place-Automaten auf 
das Verfahren von Grunow et al. [5], für Chip-Shooter auf Grunow [3] sowie für 
modulare Bestückungsautomaten auf Grunow et al. [6] zurückgegriffen. Die erhal- 
tenen Bestückungszeiten pro Bauelement lassen sich relativ zu denjenigen des 
schnellsten Automaten als Bestückungsfaktoren angeben. Tabelle 1 zeigt die Er- 
gebnisse der ersten Stufe für die ausgewählte Leiterplatte. 



Tab, 1. Ergebnisse der ersten Stufe der Heuristik 



Automat 


Bestückungszeit 

(Sekunden) 


Anzahl Bau- 
elementtypen 


Anzahl Bestü- 
ckungsoperationen 


Bestückungs- 

faktor 


Modular 


22,86 


43 


298 


1,00 


Collect&Place 


79,06 


43 


298 


3,46 


Pick&Place 


362,76 


43 


298 


15,87 


Chip-Shooter 


28,28 


43 


298 


1,24 



Stufe II: Berücksichtigung der Magazinplatzkapazität der Automaten. In der 

zweiten Stufe des Verfahrens wird eine Lösung ermittelt, bei der die begrenzten 
Magazinkapazitäten der Automaten berücksichtigt und nur solche Bestückungs- 
operationen zugelassen werden, bei denen die zugehörigen Bauelementtypen auch 
auf dem Automaten gerüstet sind (Berücksichtigung der Nebenbedingungen (3) 
und (4) des Optimierungsmodells). Hierbei werden auch die Einschränkungen be- 
züglich des für einen Automaten technisch zulässigen Bauelementespektrums be- 
achtet. 
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Im Einzelnen werden die folgenden Schritte durchlaufen: 

1. Für jede technisch zulässige Bauelementtyp- Automaten-Kombination wird ein 
Prioritätswert als Quotient aus der Anzahl der von dem Bauelementtyp zu be- 
stückenden Bauelemente und dem Bestückungsfaktor des betreffenden Auto- 
maten bestimmt. 

2. Nach Maßgabe des maximalen Prioritätswerts aller technisch zulässigen Bau- 
elementtyp- Automaten-Kombination und unter Beachtung der begrenzten Ma- 
gazinkapazitäten werden die Bauelementtypen und somit auch die zugehörigen 
Bestückungsoperationen den jeweiligen Automaten zugeordnet. (Man beachte, 
dass in diesem Schritt Bestückungsoperationen vorerst noch mehreren Automa- 
ten zugeordnet sind, Nebenbedingung (5) des Optimierungsmodells also noch 
vernachlässigt wird.) 

3. Die Automatensteuerung wird aktualisiert, d.h. aufgrund der den Automaten 
zugeordneten Bauelementtypen und Bestückungsoperationen werden eine neue 
Magazinbelegung und neue Bestückungssequenzen ermittelt. Hierzu kommen 
wie zuvor die Verfahren von Grunow et al. [5], Grunow [3] sowie Grunow et 
al. [6] zum Einsatz. Gleichzeitig werden neue Bestückungsfaktors bestimmt. 

Die Ergebnisse der zweiten Stufe des Verfahrens sind in Tabelle 2 dargestellt. 



Tab. 2« Ergebnisse der zweiten Stufe der Heuristik 



Automat 


Bestückungszeit 

(Sekunden) 


Anzahl Bau- 
elementtypen 


Anzahl Bestü- 
ckungsoperationen 


Bestückungs- 

faktor 


Modular 


22,86 


43 


298 


1,00 


Collect&Place 


27,61 


5 


97 


3,71 


Pick&Place 


34,57 


1 


25 


18,03 


Chip-Shooter 


22,37 


22 


242 


1,26 



Stufe III: Belastungsausgleich zwischen den Automaten. Abschließend wird 
jede Bestückungsoperation definitiv nur einem einzigen Automaten zugeordnet 
(Berücksichtigung von Nebenbedingung (5) des Optimierungsmodells). Hierzu 
wird ein einfaches binäres Optimierungsmodell aufgestellt und mit Hilfe von Stan- 
dardsoftware innerhalb weniger Sekunden gelöst. In der Magazinrüstung eines 
Automaten verbleiben nur diejenigen Bauelementtypen, die auch tatsächlich auf 
dem Automaten bestückt werden. Danach werden für jeden Automaten erneut die 
Magazinbelegung und die Bestückungssequenzen aktualisiert. Man erhält die in 
Tabelle 3 dargestellte Abschlusslösung. Die Taktzeit der Linie ergibt sich aus der 
Bestückungszeit des Chip-Shooters von 13,89 Sekunden. Der am wenigsten be- 
lastete Automat weist immerhin noch eine Auslastung von 96,1 1% auf. 



Tab. 2. Ergebnisse der dritten Stufe der Heuristik 



Automat 


Bestückungszeit 

(Sekunden) 


Anzahl Bau- 
elementtypen 


Anzahl Bestü- 
ckungsoperationen 


Bestückungs- 

faktor 


Modular 


13,68 


31 


101 


1,00 


Collect&Place 


13,35 


4 


46 


3,71 


Pick&Place 


13,80 


1 


10 


18,03 


Chip-Shooter 


13,89 


18 


141 


1,26 
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4. Fazit 

Die Leistungsabstimmung von Montagelinien zur Leiterplattenbestückung stellt in 
der industriellen Praxis ein wichtiges, aber häufig unbefriedigend gelöstes Pla- 
nungsproblem dar. Die in kommerziell angebotener Software implementierten 
Verfahren gehen ebenso wie die bisher in der Literatur veröffentlichten Ansätze 
von einer gegebenen Bestückungsleistung der Automaten aus. Tastsächlich hängt 
die effektive Bestückungsleistung der Automaten ganz wesentlich von der Breite 
des Bauelementespektrums und der Anzahl von Bauelementen je Leiterplatte so- 
wie der zur Automatensteuerung eingesetzten Algorithmen ab. Daher wurde ein 
Verfahren entwickelt, das diese Einflussfaktoren integrativ erfasst. Weitere nume- 
rische Untersuchungen zur Analyse der Güte des Verfahrens stehen noch aus. 
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Abstract. We present a priority-rule based method for batch production schedul- 
ing in the process industries. The problem consists in scheduling a given set of 
operations on a batch plant such that the makespan is minimized. Each operation 
consumes given amounts of input materials at its start and produces given amounts 
of output materials at its completion. An initial, a maximum, and a minimum stock 
level are specified for each material. Some materials are perishable and thus cannot 
be stored. The operations may be executed on alternative processing units. Process- 
ing units require cleaning between certain operations and before any idle time. Due 
to the constraints on material availability and storage capacity, classical schedule- 
generation schemes cannot be applied to this problem. That is why we propose a 
new two-phase approach dealing with the two types of constraints separately. 



1 Introduction 

In the process industries, the production of final products takes place by run- 
ning various processes (hereinafter referred to as tasks) that change the at- 
tributes or composition of the input. In some of the most important branches 
of the process industries, e.g. in the life science industries, customers typi- 
cally order low volumes of a great variety of products. In those industries, 
production is typically carried out on multi-purpose plants operated in batch 
production mode. A multi-purpose plant consists of processing units that can 
operate different tasks. Some tasks can be executed on alternative processing 
units, which may differ in processing and cleaning times. In general, raw ma- 
terials, intermediates, and final products can be stocked in storage facilities. 
In batch production mode, all material flows are discontinuous, where for 
simplicity we suppose that the input of a task is consumed at the start, and 
the output becomes available at the completion of the task. A batch asso- 
ciates a task with the respective input and output quantities consumed and 
produced. The processing of a batch is called an operation. A task may be 
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carried out more than once, resulting in several operations. The processing 
time of an operation is assumed to be independent of the batch size. 

In what follows, we illustrate some features typical of batch production in 
the process industries using a case study for short-term production scheduling 
presented in Westenberger and Kallrath [8]. Given the primary requirements 
for all final products, short-term production scheduling is concerned with 
finding a set of batches and a detailed occupancy plan for the multi-purpose 
plant in such a way that the production makespan is minimized. The following 
extended version of the state-task network (STN) concept (cf. Kondili et 
al. [4]) allows for a concise description of short-term production scheduling 
problems. An STN is a directed graph containing three types of elements: 

• State nodes represent the raw materials, intermediates, and final prod- 
ucts. They are drawn as ovals indicating the state number, and the initial, 
minimum, and maximum stock levels of the corresponding product. Some 
of the intermediate products cannot be stocked. In this case the oval is 
labelled with “ns” . The value oo for the initial or maximum stock levels 
means that there is sufficient initial stock or unlimited storage capacity 
available, respectively. 

• Task nodes stand for the processes, which transform one or more input 
products into one or more output products. The task nodes are repre- 
sented as rectangles labelled with the task number, the interval of feasible 
batch sizes /?, the required processing unit U, as well as the process- 
ing/cleaning times of the task. If a task can be executed on alternative 
processing units, the corresponding processing and cleaning times are 
listed for each unit. In the case study, a processing unit needs to be 
cleaned after the completion of a task if one passes to a task with a 
higher number or if no task is started immediately after the completion 
of the preceding one. 

• Arcs linking state and task nodes belong to material flows. If more than 
one input product is consumed or more than one output product is pro- 
duced, the corresponding input or output proportions are specified on 
the arcs. For some tasks, the input or output proportions can be chosen 
by varying certain process parameters. In this case, the arcs are labelled 
with the intervals of feasible proportions x. 

Figure 1 shows the STN for the batch production of the case study with 19 
products, 17 tasks, and 9 processing units. Alternative processing units are 
available for processing tasks 10 to 14, 16, and 17. 

Several authors have presented solution methods for short-term produc- 
tion scheduling in process industries and have used the above case study to 
compare the performance of their planning methods. Most of the approaches 
are based on the time-indexed formulation of the planning problem as a 
mixed-integer linear program presented by Kondili et al. [4]. Blömer and 
Günther [1], [2] develop various heuristic methods for reducing the number 
of decision variables. Burkard et al. [3] apply rounding heuristics for the case 




113 




Fig. 1. State-task network for case study 



without cleaning times. Neumann et al. [6] decompose the short-term produc- 
tion scheduling problem into a batching and a batch (production) scheduling 
problem. A solution to the batching problem provides the numbers and sizes 
of batches for all tasks subject to inventory balance and storage capacity con- 
straints. This problem can be formulated as a mixed-binary linear program 
of moderate size (cf. Neumann et al. [6]). For a given set of operations, the 
batch scheduling problem is concerned with the scheduling of the operations 
on the processing units subject to inventory balance and storage capacity con- 
straints. Neumann et al. [6] develop a truncated branch-and-bound method 
for solving the batch scheduling problem. Following the lines of the decom- 
position approach, in this paper we present a priority-rule based method for 
the latter problem. 
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2 Problem Statement 

In this section, we outline a formal statement of the batch scheduling problem. 
For details we refer to Neumann et al. [6]. 

Suppose that n operations 1 , . . . , n have to be scheduled. For notational 
convenience we introduce two fictitious operations 0 and n_+ 1 representing 
the production start and the production end, respectively. V := {1, . . . , n} is 
the set of all real operations, and V := FU{0, n-f 1} is the set of all operations. 
Let Si > 0 be the sought start time of operation i. coincides with the 
production makespan. Vector S = ( Si)i e y with So = 0 is called a schedule. 

Each processing unit can be viewed as a renewable resource (cf. Neu- 
mann et al. [7], Sect. 2.1) of capacity 1. Let 7 Z p be the set of all renewable 
resources and 1Z? be the set of those alternative renewable resources on which 
operation i can be carried out. For i G V and k G 1Z? , the binary decision 
variable x & indicates whether or not resource k processes operation i (xik = 1 
or = 0, respectively). Each real operation i must be executed on exactly 
one processing unit, i.e., J2ken? = 1 e V). Vector x = (%ik) ie y kenP 
is then called an assignment of operations i to processing units k. By Pi(x) 
and Ci(x) we denote the processing and cleaning times of activity i given 
assignment x, where we suppose that Pi(x) = Ci(x) = 0 for i = 0, n -f 1. 

The need for cleaning a processing unit generally depends on the oper- 
ations sequence on this unit. Let Pk C V x V be the set of operation pairs 
(i,j) for which passing from i to j requires a cleaning of processing unit k. 
Given a schedule S and an assignment x, let Ok(S,x) designate the set of 
all pairs (z,j) such that i ^ j, Si < 5^, and x^ = Xjk = 1. 0^(5, x) can 
be partitioned into the set Ck(S,x) containing all pairs (z, j) for which k has 
to be cleaned between z and j (because (i,j) G Pk or Sj > Si + Pi(x)) and 
the set Ck(S,x ) of pairs for which j must be started immediately after the 
completion of operation z. A schedule S is called process-feasible with respect 
to assignment x if 

Sj > Si+pi(x) +Ci(x), if (i,j) G Ck(S,x) 

Sj = Si +Pi(x), if (z, j) G C k (S,x) 

Now we turn to the storage facilities, which represent so-called cu- 
mulative resources (cf. Neumann and Schwindt [5]). For each nonperishable 
product, there is one cumulative resource keeping its inventory. Let 1Z 1 be 
the set of all cumulative resources. For each k G 7£ 7 , a minimum inventory 
R k (safety stock) and a maximum inventory Rk (storage capacity) are given. 
Each operation z G V has a demand for resource k G 7 Z 1 . If > 0, 
the inventory of resource k is replenished by units at time Si + Pi(x). 
If rik < 0, the inventory is depleted by — units at time Si. rok repre- 
sents the initial stock level of resource k. Let V^~ := {z G V | > 0} and 

Vjf := {z G V | r^ < 0} be the sets of operations replenishing and depleting, 



j (k G TV) (1) 
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respectively, the inventory of k G 7£ 7 . Schedule S is said to be storage- feasible 
with respect to assignment x if 

R k < rik + Tik < Rk ( k G 7£ 7 , t > 0) (2) 

ieVf:Si+pi(x)<t i^.V~:Si<t 

Usually temporal constraints of the type Sj > 5* + %(x) for (i,j) G E 
with E CVxV have to be taken into account as well. Sij ( x ) is a minimum 
time lag between the start of activities i and j. If Sij(x) < 0, then —Sij(x) can 
be interpreted as a maximum time lag between the start of operations j and i. 
In case of Sij(x) = Pi(x ), the corresponding temporal constraint is referred 
to as a precedence constraint. For each operation i G V we set Soi(x) := 0 
and 5i, n +i(x) := Pi{x) + c*(x). Based on time lags Sij (x) for (i,j) G E we 
can compute distances dij(x) between any two activities i,j G V. Distances 
dij (x) coincide with the minimum time lags between activities i and j that are 
implied by the prescribed time lags (see e.g., Neumann et al. [7], Sect. 1.3). 
Given an assignment x, a schedule S satisfying Sj > Si + %(x) for all 
(i,j) G E is called time-feasible with respect to x. 

A schedule which is time-, process-, and storage- feasible with respect to 
some assignment x is called feasible with respect to x. A pair (S', x) is a 
feasible solution to the batch scheduling problem if x is an assignment and 
S is a feasible schedule with respect to x. The batch scheduling problem 
consists in finding a feasible solution (5, x) with minimum makespan £ n +i. 

3 Solution Method 

The basic idea of the new priority-rule based solution method is as follows. At 
first, we choose an assignment x of operations to processing units, where we 
balance the workload to be processed on alternative processing units by using 
a simple greedy heuristic. The method then consists of two phases. During the 
first phase, we relax the storage-capacity constraints. Using a serial schedule- 
generation scheme, the operations are iteratively scheduled on the processing 
units in such a way that the inventory does not fall below the safety stock at 
any point in time. Deadlocks are avoided by means of a specific unscheduling 
technique. Based on the resulting schedule, precedence constraints between 
replenishing and depleting operations are introduced according to a FIFO 
strategy. Those precedence constraints ensure that the material-availability 
constraints are always satisfied. In the second phase, which again applies the 
serial schedule-generation scheme, the operations are scheduled subject to 
the storage-capacity and the precedence constraints introduced. 

In the balance of this section we explain the schedule-generation scheme 
of the first phase in more detail. We then briefly sketch the modifications 
needed for using the scheme in the second phase. Since assignment x has 
been fixed, we from now on omit x in the notation of processing times, time 
lags, and inventory levels. 
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Let Pred(j) be the set of predecessors of node j with respect to the strict 
order {(i, j) G V x V \ dij > 0 and dji < 0}. i G Pred{j) means that ac- 
tivity i must be started no later than activity j but that conversely, activ- 
ity j may be started after activity i. Moreover, denote the completed set 
of activities i already scheduled by C and let S c := (Si)i^c be the partial 
schedule constructed. We say that an activity j ^ C is eligible for being 
scheduled if (i) all of its predecessors have been scheduled, i.e., Pred(j) C C 
and (ii), the inventory levels in all cumulative resources do not fall below 
the safety stocks after the completion of all activities from set C U {j}, i.e., 
r k (S c , oo ) + rjk > R k for all k G PP . 

The procedure is now as follows (see Algorithm 1). At first, we initialize 
the earliest and latest start times ESi and LSi for all i G V. In each iteration 
of the schedule-generation scheme we then determine the set £ of eligible 
activities jf, select one activity j* G E according to priority indices n (j), 
determine the earliest feasible start time t* > ESj* for activity j*, schedule 
j* at time £*, and update the earliest and latest start times of the activities 
i not yet scheduled. Starting with partial schedule S c where C = {0} and 

50 = 0 we perform those steps until all activities have been scheduled, i.e., 
until C = V. 

Sometimes it may happen that due to maximum time lags between sched- 
uled activities i G C and the activity j * selected, the latest start time LSj* of 
j* is strictly smaller than time t*. Then no feasible start time can be found 
for activity j*, and S c cannot be extended to a feasible schedule. In this case, 
we perform the following unscheduling step. At first, we determine the set 
U = {i G C | LSj — Si — dj*i} of all activities i that must be delayed in order 
to increase the latest start time of j *. Then, we increase the earliest start 
times of activities i from set U to time S\ + t* — LSj * , update the distances 
dij accordingly, and restart the scheduling procedure. In the implementation 
shown in Algorithm 1, the number u of unscheduling steps is limited by some 
upper bound ü. 

After having obtained a time- and process- feasible schedule satisfying the 
material-availability constraints, we link producing and consuming operations 
following a FIFO strategy. This means that for each k G P 1 we iterate the 
replenishing activities i G V k according to nondecreasing completion times 

51 +pi and allot the corresponding units to depleting activities j G in 

the order of nondecreasing start times Sj. For each pair (i,j) G xVjf for 
which j consumes units produced by i, we introduce a precedence constraint 
between i and j by setting 5ij ma x(5ij,pi). Subsequently, we update the 

distances d ij and proceed with the second phase of our procedure. 

When during the second phase we deal with storage-capacity instead of 
material-availability constraints, we define the eligible set to be £ := {j G 
V \ C | Pred(j) C C, r k (S c , oo) + rj k < R k for all k G P 1 }. In the definition 
of £, we use the predecessor sets Pred(j) from the first phase in order to allow 
for the scheduling of depleting operations before the replenishing operations 
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Algorithm 1 Schedule-generation scheme: Ensuring material availability 
u 0; 

2: So := 0, C := {0}; 

for all i G V do (* initialize ESi and LSi *) 

ESi . — doi 5 LSi . — d%Q) 

while C do 

S := {j G V \ C | Pred(j) C C, rk(S c , oo) + r jk > R k for all k G 7£ 7 }; 
j* •= min{j G S | tt (j) = exthesn(h)}; 

t' := min{£ > ESj* | r k (S c ,r ) + rj* k > for all /c G 7^ 7 , r > ^}; 
t* := min{5j* > t' \ S Cu ^ ^ is process-feasible}; 
if t* > LSj* then (* unschedule and restart *) 
u := u + 1; 

if it > 17 then terminate; 

:= {i G C | LiSj* = Si — dj*i }; 
for all i €14 do doi := ä + t* — LSj* ; 
update distances dij for all i,j €V and goto line 2; 
else (* schedule j* at time t* *) 

Sj* :=t',C:=CU{j'}; 

for all j G V \ C do (* update ESj and LSj *) 

ESj ma x(ESj,Sj* + dj*j); 

LSj . — xim\(^LSj j Sj* djj *); 

return S; 



allotted to them have been added to the partial schedule. The earliest storage- 
feasible start time of activity j* is now given by t f := min{£ > ESj. | 
rk(S c ,t) +rjk < Rk for all k 6 TV 1 , t > t+pj* }. In this way, we ensure that 
any partial schedule S c is feasible. 

4 Experimental Performance Analysis 

We have compared a randomized multi-pass version of the new priority-rule 
based method (PRM) to two alternative solution procedures from literature: 
the time grid heuristic (TGH) by Blömer and Günther [1] and the trun- 
cated branch-and-bound procedure (TBB) for batch scheduling devised in 
Neumann et al. [6]. We have used the test set introduced by Blömer and 
Günther, which has been constructed by varying the primary requirements 
for final products in the case study described in Section 1. For each instance, 
we have computed an optimal solution to the batching problem. This solution 
defines the batch scheduling problem that is (approximately) solved by the 
PRM and TBB heuristics. The results obtained for the 22 problem instances 
are displayed in Table 1, where a star marks those instances for which the 
priority-rule based method has been able to improve upon the best makespan 
known thus far. The results indicate that in particular for large problem in- 
stances, the new method compares favorably with the best algorithms from 
literature. 
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Table 1. Computational results 



In- 


Primary 


TGH 


TGH 


TBB 


TBB 


PRM 


PRM 


stance 


requirements 


Sn+ 1 " 


time b 


Sn+l* 


time 0 


c* a 

1 


time 0 


1 


(20,20,20,0,0) 


36 


1110 


36 


3 


39 


60 


2 


(20,20,0,20,0) 


42 


2247 


38 


13 


47 


60 


3 


(20,20,0,0,20) 


42 


2487 


38 


17 


48 


60 


4 


(20,0,20,20,0) 


48 


1550 


39 


60 


42 


60 


5 


(20,0,20,0,20) 


44 


1778 


41 


60 


41 


60 


6 


(20,0,0,20,20) 


48 


3605 


43 


60 


49 


60 


7 


(0,20,20,20,0) 


52 


2587 


38 


60 


44 


60 


8 


(0,20,20,0,20) 


48 


3123 


39 


60 


43 


60 


9 


(0,20,0,20,20) 


54 


3607 


53 


60 


49 * 


60 


10 


(0,0,20,20,20) 


60 


3607 


50 


60 


54 


60 


11 


(10,10,20,20,30) 


68 


3605 


66 


60 


64 * 


60 


12 


(30,20,20,10,10) 


60 


3605 


52 


60 


48 * 


60 


13 


(10,20,30,20,10) 


64 


3604 


50 


60 


57 


60 


14 


(18,18,18,18,18) 


66 


3606 


57 


60 


61 


60 


15 


(15,15,30,30,45) 


148 


3622 


114 


60 


100* 


60 


16 


(45,30,30,15,15) 


124 


3628 


80 


60 


80 


60 


17 


(15,30,45,30,15) 


112 


3621 


91 


60 


92 


60 


18 


(27,27,27,27,27) 


124 


3631 


91 


60 


90 


60 


19 


(20,20,40,40,60) 


208 


5152 


135 


60 


159 


60 


20 


(60,40,40,20,20) 


184 


3638 


100 


60 


97* 


60 


21 


(20,40,60,40,20) 


184 


3643 


112 


60 


124 


60 


22 


(36,36,36,36,36) 


214 


3635 


134 


60 


114 * 


60 



a best makespan found 

b CPU time in seconds on a Pentium-266 PC, procedure stopped after one hour if feasible 
solution could be found 

c CPU time in seconds on a Pentium-800 PC, procedure stopped after one minute 
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Abstract. The transportation of hazardous materials is a growing problem due to 
the increasing transported volumes. What differentiates hazardous material ship- 
ments from shipments of other materials is the risk associated with an accidental 
release of hazardous materials during transportation. A possible solution to reduce 
the occurrence of dangerous events is to provide travel plans that establish a fair 
spatial and temporal distribution of the risk. The objective of this work is to study 
the problem of routing and scheduling a set of hazardous materials shipments, min- 
imizing the travel total risk while spreading the risk among different zones of the 
geographical region where the transportation network is defined. We propose a ge- 
netic algorithm that, given a set of dissimilar routes for every origin-destination 
pair, selects a route and defines a departure time for every shipment with the aim 
of minimizing the total risk of the travel plans. The genetic algorithm is experi- 
mentally evaluated on a set of realistic scenarios defined on a regional area. 



1 Introduction 

In recent years there has been increased public and governmental concern re- 
garding hazardous materials management as the production of such materials 
has increased. Hazardous materials, or dangerous goods, include explosives, 
gases, flammable liquids and solids, oxidizing substances, poisonous and infec- 
tious substances, radioactive materials, corrosive substances, and hazardous 
wastes: all important substances for industrial societies. Unfortunately, most 
hazardous materials are not used at their point of production, and they 
are transported over considerable distances. What differentiates shipments 
of hazardous materials from shipments of other materials is the risk asso- 
ciated with an accidental release of these materials during transportation. 
This can be extremely dangerous both with respect to the environment and 
to human health, since exposure to their toxic chemical ingredients could lead 
to the injury of plants, animals and humans. For these reasons, a carefully 
selection of a set of routes that involves less total risk and an equity distri- 
bution of the risk over the geographical region in which the transportation 
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network is embedded is necessary to prevent accidents, or, if they happen, to 
minimize their impact. 

The modeling of transportation problems is a popular application area in 
OR. In most transportation planning models, the objective is to move prod- 
ucts from origins to destinations at minimal cost. However, for hazardous 
materials shipments, a cost minimizing objective is usually not suitable. The 
risk associated with hazardous materials makes these problems more compli- 
cated than many other transportation problems. There are several excellent 
review articles which address the literature related to modeling of risk for 
hazardous materials transportation; however, there is no universally defini- 
tion of risk. In this paper we refer to the traditional definition of risk over a 
link, that is the societal risk defined as the product of the population along 
the link within the neighborhood and the probability of an incident [2] . 

Several models have been proposed in literature that allow to determine 
routes of minimum risk under the tie of equity. The concept of dissimilar 
paths has also been considered in order to guarantee the spreading of risk [1]. 
Indeed, these methods address only the hazardous materials routing problem, 
allowing only to spatially spread equitably the risk over a region, but they 
do not consider the spreading the risk equitably over time. 

This paper deals with the problem of routing and scheduling a set of haz- 
ardous materials shipments, minimizing the travel total risk while spreading 
the risk among different zones of the geographical region where the trans- 
portation network is defined, and also over time. We propose a genetic algo- 
rithm that, given a set of dissimilar routes for every origin-destination pair, 
selects a route and defines a departure time for every shipment with the aim 
of minimizing the total risk of the travel plans. The genetic algorithm is ex- 
perimentally evaluated on a set of realistic scenarios defined on a regional 
area. 

2 Problem Definition 

We model a transportation network by a graph G — (iV, L), where N is the 
set of nodes representing relevant locations in the geographical area, and L 
is the set of links. Each link l G L has two weights associated with it, that is, 
the travel time ti , and the risk index pi , respectively. 

Let S be a set of shipments. For each shipment s G 5, let o s G iV, d s G iV, 
pdt s , be the origin node, the destination node and the preferred departure 
time, respectively. Let P s be the given set of dissimilar routes (with each path 
p defined by a subset L p of links in L) connecting node o s to node d s and let 
r(p) — J2ieL Pi the risk of the route p G P s . 

Let x sp be a decision variable equal to 1 if the route p G P s is assigned to 
the shipment s, and 0 otherwise. The objective is, for each shipment s G S', 
to select a route p G P s and assign a departure time dt s G [pdt s — A , pdt s 4- A] 
that solve the following optimization model: 
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subject to 



min 2 = r(p)x sp + 


a^2pici(dt,x) 


(1) 


seSpePs 


leL 




^ ] %sp — 1? 


Vs € S 


(2a) 


peP s 






dt s > pdt s — A , 


Vs € S 


(2b) 


dt s < pdt s + A, 


Vs eS 


(2c) 


o' 

AI 

<0 


Vs €5 


(2d) 


x sp e {0, 1}, Vs e S, 


VpeP. 


(2e) 



I n (1), J2 seS ^2 P ep s r(p)xsp represents the total risk of the plan, while 
YlieLPi c i( dt, x ) denotes the risk associated to conflicts arising from simul- 
taneous traversing of a link (or close links) as a function of the travel plan. 

In the latter expression, c/(dt,x) is the number of conflicts on link l. 
Given the shipments s and s' , let p s and p s > be the their assigned routes. Let 
Ei be the set of links located in the closed neighborhood (i.e., containing also 
link l ) of l. There is a conflict on link l if s is traveling on that link and s' 
is traveling on a link e E Ei , simultaneously. 

Finally, parameter a weights the risk associated to conflicts. The grater a 
the higher is the importance of equitably risk spreading with respect to the 
minimization of the total risk of the plan. 

By scheduling the departure time carefully, the risk of each shipment can 
be reduced, and the safety of each shipment can be ensured. 

Combining scheduling and routing analysis generally increases the compu- 
tational complexity required in treating these components separately. Conse- 
quently, even though scheduling and routing decisions are intimately related, 
their combined analysis has received considerably less attention than is de- 
served in general. 

We have decided to follow a metaheuristic approach, designing a genetic 
algorithm to solve this problem. 



3 Genetic Algorithms 

Genetic algorithms (e.g., see [4]) are a family of computational models in- 
spired by evolution. These algorithms encode a potential solution to a specific 
problem on a simple chromosome like data structure and apply recombina- 
tion operators to these structures so as to preserve critical information. Two 
characteristic aspects of many traditional algorithms are completely extrane- 
ous to the genetic algorithms: the risk that the optimum found is local only 
and not global, and the dependence from the existence of derives. Likewise, 
methods of exhaustive character or random search, even not introducing the 
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two characteristics now quoted, does not reveal also a satisfactory degree of 
efficiency, because very often the spaces of search are very vast. 

An implementation of a genetic algorithm begins with a population of 
(typically random) chromosomes. Even if a genetic algorithm uses selection 
and recombination operators to generate new sample points in a search space, 
which are natural selection laws, there exists a kind of decisive factor which 
guides the algorithm to recognize the elements to combine in order to design 
the next generations: that is, their fitness function, which represents the ob- 
jective function value obtained by the evaluation of the parameters for that 
particular element. 

An evaluation of these chromosomes gives the possibility to allocates re- 
productive opportunities in such a way that those chromosomes which have 
a function value better than the others are given more chances to reproduce. 
The goodness of a solution is typically defined with respect to the current 
population. 

First of all two chromosomes that belong to the current generation are 
selected (according to their fitness function), then a random cut point is 
selected and pairs of chromosomes are mated. After this operation, called 
crossover, the mutation of the chromosomes starts, that is, a random change 
of the value of one particular parameter of the selected element. 

Genetic algorithms require that all the variables of the optimization prob- 
lem are codified, using an opportune alphabet, in form of string. 



4 Implementation 

The first step we have to take in order to solve the problem of routing and 
scheduling using genetic algorithms is to define a suitable coding. 

Let n be the number of shipments and let K be the number of dissimilar 
routes at minimum risk for each shipment. Fig. la shows how each chro- 
mosome codifies a possible solution of our problem, and Fig. lb shows that 
one gene, formed by two alleles, is used to represent the directive of each 
shipment. The former allele al® represents the assigned departure time of the 
shipment, and the latter al 1 represents the assigned route. 

Let al l be the allele al 1 of the z-th gene (i.e., the z-th shipment), and let 
r(alj) be the risk associated to the route related to the z-th shipment. 

The allele for scheduling (i.e., representing the assigned departure time) 
uses as alphabet the set of integer numbers in [—A, A], with A being the max- 
imum number of time slot that a shipment could be anticipated or delayed 
with respect to the preferred departure time: the value of this allele of the 
gene at position z indicates the time variation from the preferred departure 
time of z-th shipment; that is, the departure time dti of z-th shipment is given 
by dti — pdU + 6 al®, where 5 is the time slot length (e.g., <5 = 15 minutes, 
A = 2). 
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a) 



Directive for shipment s i 



\ 

al® : allele for scheduling al} : allele for routing 



b) 



Fig. 1 . Genetic representation: (a) chromosome; (b) gene (shipment directive) 



The allele for routing uses as alphabet the set of integer numbers in [1, if]: 
the value of this allele of the gene at position i indicates which one of K pre- 
calculated dissimilar routes at minimum risk is assigned to the i-th shipment. 

4.1 Fitness Function 

In the evolution theory of the biological systems, the probability of survival 
of an individual depends on its ability to adaptation to the environment 
(fitness). 

The fitness function ff(ch) is the objective function (1) expressed in terms 
of a chromosome eft, that is: 



n 

ff(ch) = ^r(al}) +aJ2pici(al 1 ,al°), (3) 

i= 1 leL 

where al°, al 1 are the set of alleles of chromosome eft, representing departure 
times and assigned routes, respectively. 

Given the departure time of the shipment s and given the times required 
to travel on each link of the route assigned to s, it is possible to compute, for 
each link of that route, the time interval when the link is traversed by s. Let 
7/ be the set of such time intervals related to link Z, computed considering all 
the shipments. Accordingly, there is a conflict on a link Z if there is at least a 
pair of intersecting time intervals in //. Moreover, we also consider possible 
conflicts on two close links, say links Zi, I 2 ' there is a conflict if there is at 
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least a pair of intersecting time intervals, the former one belonging to 7^ and 
the latter one to 7/ 2 . We consider close links that ones being at distance not 
grater than a given value. 

Clearly, the chromosome with minimum fitness function value is the best. 
Next the operators reproduction, crossover and mutation are discussed. 

4.2 Reproduction 

Reproduction is a process in which chromosomes are selected according to 
their fitness function (//) value. We have implemented the reproductive op- 
erator creating a biased roulette wheel where each chromosome ch in the 
current population has a slot sized inversely (being a minimization problem) 
proportional to its // value and proportionally to its reproduction probability 
pr(ch). 

The turn of the wheel is simulated twice; so two elements are selected. 

4.3 Crossover 

The second operator is the simple crossover or one-point crossover and works 
as follows: each pair of strings reproduced undergoes a cross-change. In order 
to do this, an integer position k (cut point) is selected uniformly at random 
among the strings between position 1 and the string length h less one. The 
crossover procedure swaps all genes between the selected position k and the 
end of the string. 

We have implemented two other types of crossover: 

• multi-point crossover: pick M cut points (po,Pu • • • ,Pm-i) at random be- 
tween 1 and h less one, sort them, and then exchange between the two 
chromosomes being crossed over the genes in the ranges [po> Pi), [P 2 , P 3 ), • • • 

• uniform crossover: for each gene position in the two chromosomes being 
crossed over, flip a coin and exchange the genes if the coin comes up 
heads. 

4.4 Mutation 

After the determination of the two new elements with the crossover, operates 
the mutation function, which plays a secondary role with respect to repro- 
duction and crossover operators. A gene selected for mutation is replaced by 
a random value between lower and upper bounds of the alphabet of the gene. 

This procedure gives a random alteration of the value of the genes that 
forms the chromosomes, with small probability, and guarantees the explo- 
ration of some regions in the search space not observed yet. 

Once we have processed the population through the three fundamental 
operators, a new generation is created. The new fitness values are calculating 
and the best chromosome is tagged, that is, the one with the best fitness 
value. 
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5 Preliminary Results and Conclusions 

The genetic algorithm implementation was written in Java and the calcula- 
tions were carried out on a PC with a 450 MHz Pentium II processor. 




Fig. 2. The regional road network for the experiments 



In order to test the performance, calculations have been performed on a 
realistic regional road network, shown in Fig. 2, with 311 nodes and 441 links. 

We have fixed 24 origin-destination pair and 5 shipments for pair; then 
chromosomes have length 120, being the total number of shipments. Every 
shipment has a randomly generated preferred departure time in the interval 
[07:00 AM, 08:00 AM]. The time slot length S is 15 minutes and A = 2, then 
pdti — 2 6 < dti < pdti + 2 J, that is pdti — 30 min < dti < pdti + 30 min. 

For each origin-destination pair we have precalculated 3 dissimilar routes 
at minimum risk using the Iterative Penalty Method [3]. 

Population size is a factor that effects the GA performance. Increasing 
the population means a longer computational time; on the other hand, if the 
population size decreases, the same happens to the accuracy of the solution, 
because of reduced variation of chromosomes. In GA design there must be 
a balance between the generation numbers and population size. Evaluation 
of chromosomes and fitness calculations are the most time consuming parts 
of a GA. If the evaluation operation is reduced, GA process will work faster 
and this can be achieved by reducing the population size and numbers of 
generation needed to reach a solution. Parameters in the proposed GA are 
set as: population size N = 20, and maximal search generation / max = 200. 
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In the following tables we report results of a set of experiments 
performed with different combinations of crossover and mutation prob- 
ability. In particular we have considered different crossover probabil- 
ities ( cp = 0.50,0.70,0.85,1.00) and mutation probabilities (mp = 

0.001, 0.010, 0.100, 0.200) and 10 trials are done for each combination. Results 
show that the best // value is obtained with (cp = 0.85, mp = 0.200), and 
(cp = 0.70, mp = 0.100), using one-point crossover and uniform crossover, 
respectively. 

Table 1. Best fitness values for different combinations of crossover and mutation 
probability using one-point crossover 



mp 


cp = 0.50 


0.70 


0.85 


1.00 


0.001 


9104974.2 


8985228.2 


8959705.4 


8823420.6 


0.010 


8798133.8 


8737627.4 


8908269.0 


8877275.6 


0.100 


8833818.4 


8806757.2 


8722281.4 


8736266.3 


0.200 


8644340.3 


8579511.3 


8576728.0 


8600005.0 



Table 2. Best fitness values for different combinations of crossover and mutation 
probability using uniform crossover 



mp 


cp = 0.50 


0.70 


0.85 


1.00 


0.001 


9173154.3 


8982624.2 


8851794.2 


8633443.3 


0.010 


8727306.6 


8873224.6 


8731722.6 


8755767.0 


0.100 


8620333.4 


8588053.8 


8679612.2 


8785719.3 


0.200 


8703173.3 


8678770.0 


8725388.6 


8785198.0 



Further developments concern the algorithm test considering different 

methods to find dissimilar paths at minimum risk and a comparison of the 

performance with an other metaheuristic approach based on Tabu Search. 
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Zusammenfassung Die Diskussion um eine leistungsfähige und auch 
kostengünstige Entsorgung der anfallenden Müllmengen hat sich in den 
vergangenen Jahren erheblich verschärft. Dies bezieht sich (u.a.) auch auf die 
Hausmüllentsorgung, die durch die unmittelbare Betroffenheit der privaten 
Haushalte, eine (kommunal-)politische Dimension beinhaltet. Diese Situation 
erzwingt eine stärkere Beachtung betriebswirtschaftlicher Zielsetzungen, u.a. in 
der Form von betriebsinternen Kostensenkungsmaßnahmen. Ein wesentlicher 
Aspekt ist in diesem Zusammenhang die Verbesserung der Tourenplanung sowie 
der Personaleinsatzplanung in der Müllentsorgung. Ein möglicher Lösungsansatz 
für diese Problemstellung wird in den Grundzügen skizziert. Außerdem werden die 
mit einer Realisierung verbundenen Randbedingungen beschrieben sowie 
notwendige Veränderungsprozesse aufgezeigt. 

1 Anforderungen an die Entsorgungslogistik 

Die Müllentsorgung erweist sich für die kommunalen Gebietskörperschaften 
zunehmend als ein politisches und zum Teil auch als ein finanzielles Problem. Ein 
wesentlicher Bereich ist hierbei das Sammeln des anfallenden Hausmülls und der 
Transport zu Entsorgungseinrichtungen, der aufgrund einer Reihe gesetzlicher 
Regelungen in den vergangenen Jahren (u.a. durch das Kreislaufwirtschafts- und 
Abfallgesetz (KrW-/AbfG)) erheblich komplexer geworden ist. Mit den ab Juni 
2005 wirksam werdenden Regelungen für die Entsorgung (mit der verbindlichen 
Festschreibung einer geeigneten Verwertung) ergeben sich zusätzliche Anforde- 
rungen, u.a. auch an die logistischen Abläufe, für die geeignete Lösungen zu er- 
mitteln sind. 

Ein Teilbereich, der nicht genutzte Effizienzpotentiale aufweist, ist der (ope- 
rative) Personal- und Fahrzeugeinsatz bei Anwendung des Umleerverfahrens in 
der Hausmüllentsorgung. Die hier auftretenden Abläufe sind bisher weitgehend als 
in sich geschlossene Prozesse verstanden worden, bei denen Fahrzeug und Fahrer 
sowie die Ladecrew eine (nicht trennbare) Arbeitseinheit bilden. In der 
Grundstruktur bestehen diese Prozesse aus einer Einsetzfahrt (ausgehend vom 
Depot), den Sammeltouren sowie den Fahrten zum Entladen, und einer Aus- 
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setzfahrt (zurück in das Depot) (s. Abb.l.) Aufgrund von Veränderungen in den 
räumlichen Randbedingungen, u.a. durch zunehmende Entfernungen zwischen den 
Aufkommensgebieten des Hausmülls und den verschiedenen Zielorten der 
Sammelfahrzeuge (Umschlageinrichtungen, Deponien, Recyclinganlagen, etc.), 
ergibt sich ein Ansteigen der unproduktiven Zeitanteile in den Arbeitsabläufen und 
damit auch der anfallenden Kosten. 




Abb. 1: Grundstruktur der Abläufe bei der Tourenbildung in der 
Müllentsorgung 

Kostensteigerungen in diesem Marktsegment können in der Regel nur bedingt an 
den Kunden weitergegeben werden, denn Gebührenerhöhung bei öffentlichen 
Dienstleistungen sind nicht nur kaufmännische Entscheidungen, sondern sie stellen 
auch ein (kommunal-)politisches Problem dar. Dies führt zu einem erheblichen 
Druck auf die betroffenen Entsorgungsunternehmen, verstärkt Kostensenkungs- 
maßnahmen zur Erhöhung der Wirtschaftlichkeit durchzusetzen. Um diesen 
Forderungen gerecht zu werden, müssen neue Wege gesucht werden, mit denen 
auch ein Aufbrechen bestehender Strukturen verbunden sein kann. 



2 Problemstellung 

Eine mögliche Vorgehens weise zur Verbesserung der Wirtschaftlichkeit besteht in 
einer Veränderung der Entsorgungsabläufe. Der kritische Punkt liegt (u.a.) in den 
nicht produktiven Arbeitszeitanteilen der Ladecrew während der Fahrten zu einer 
Umschlagstation bzw. während der Aussetzfahrt bei größeren Entfernungen 
zwischen Depot und Entladeort. Grundlage für einen Lösungsansatz ist das Auf- 
brechen der Arbeitseinheit Fahrzeug / Fahrer / Ladecrew, mit dem Ziel, das ver- 
fügbare Ladepersonal effizienter einzusetzen. So ist in der (operativen) Personal- 
und Fahrzeugeinsatzplanung anzustreben, dass eine Ladecrew bei längeren Fahrten 
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am Abschluss einer Sammeltour, (zum Beispiel) zu einer Umschlagstation, nicht 
(untätig) auf dem Fahrzeug verbleibt, sondern an einem Ablösepunkt einem 
anderen (aktiven) Fahrzeug zugeordnet wird (s. Abb. 2). 




Hier bieten sich zwei Lösungsansätze an, zum einen ein zweistufiger Ansatz, bei 
dem zunächst eine Tourenplanung für die Fahrzeuge (und Fahrer) erfolgt und 
anschließend eine Zuordnung des Ladecrews zu den zu leistenden (produktiven) 
Tourabschnitten, sowie zum anderen ein simultaner Ansatz, der allerdings eine 
deutlich komplexere Struktur aufweist. In den folgenden Ausführungen wird, auch 
mit Blick auf die Komplexität und das betriebliche Handling, auf den zweistufigen 
Ansatz eingegangen, wobei in den Grundstrukturen von einem Ein-Depot-Problem 
ausgegangen wird. 

3 Lösungskonzept 

Die Vorgehens weise basiert auf zwei Planungsschritten, die mit (vorhandenen) 
quantitativen Verfahren bearbeitet werden können. So ist in einer ersten Stufe ein 
Capacitated Arc Routing-Problem (CARP-Problem) (s. hierzu u.a. [1], [3]), [5] 
für den Einsatz von Fahrzeug und Fahrer zu lösen. Dieses liefert, unter 
Berücksichtigung der Arbeitszeiten der Fahrer, die zu erbringenden Leistungen 
(Touren), die sich zusammensetzen aus der Einsetzfahrt, den (produktiven) 
Sammel Vorgängen und gegebenenfalls mehreren Fahrten zwischen Sammelgebiet 
und (zum Beispiel) einer Umschlagstation sowie der Aussetzfahrt am Ende der 
Tour. Bei einem Schichtbetrieb kann, mit Blick auf einen effizienten Einsatz der 
Fahrzeuge, die zulässige Länge einer Tour auch auf die tägliche Betriebsdauer 
ausgeweitet werden, was allerdings voraussetzt, das ein Fahrerwechsel innerhalb 
einer Tour ablaufmässig realisierbar ist. 
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Ausgehend von dieser Routing-Lösung werden alle produktiven Touren- 
abschnitte erfasst, die mit Ladecrews zu besetzen sind. Diese bilden den wesent- 
lichen Teil der Datengrundlagen für die Festlegung der durch die Ladecrews zu 
erbringenden Arbeitsleistungen (Dienste). Die hier zugrunde liegende Problem- 
stellung der zweiten Stufe lässt sich als (klassisches) Duty-Scheduling-Problem 
formulieren, das mit verfügbaren Verfahren effizient gelöst werden kann (s. u.a. 
[2], [6]). Abbildung 3 zeigt (in einem Ausschnitt) das Ergebnis einer solchen 
Einsatzplanung im Vergleich zu den vorhandenen Vorgehens weisen in einer 
Gantt-Darstellung. 



Einsatzplanung bei fester Zuordnung Fahrzeug / Ladecrew 
Fahrzeug / Ladecrew 1 

i m 

Fahrzeug / Ladecrew 2 



Einsatzplanung bei Auflösung der Zuordnung Fahrzeug / Ladecrew 
Fahrzeug 1 

i i 



Fahrzeug 2 

i 



- 



Ladecrew A 




Einsetzfahrt 

Fahrt zur Umschlagstation 




Sammelvorgang 

Aussetzfahrt 



Abb. 3: Beispiel Einsatzplanung (Ausschnitt) 



Allerdings bestehen bei dieser Vorgehens weise auch Probleme, da durch ein zwei- 
stufiges Vorgehen auf der algorithmischen Ebene keine unmittelbare Verknüpfung 
bzw. Rückkopplung zwischen den beiden Stufen hergestellt werden kann. Da (u.a.) 
räumliche und zeitliche Interdependenzen zwischen dem Verlauf der einzelnen 
Touren und der Einsatzplanung der erforderlichen Crews bestehen, müssen die 
automatisiert ermittelten Lösungen überarbeitet werden. In einem ersten Schritt 
können hierbei .geeignete Verbesserungsverfahren zur Anwendung kommen, die 
eine inhaltliche Verknüpfung zwischen den beiden (Teil-)Problemstellungen 
hersteilen. Außerdem ist in einem zweiten Schritt die Möglichkeit interaktiver 
Eingriffe des Planungspersonals vorzusehen, um aus betrieblicher Sicht 
erforderlichen Anpassungen bei der Touren- und Dienstebildung vornehmen zu 
können. 

Eine interaktive Anpassung der (weitgehend) automatisiert erstellten Touren- 
und Dienstpläne ist zwingend notwendig, da in der Regel eine Reihe betrieblicher 
Einzelfallregelungen, denen häufig auch eine ausreichende Konsistenz fehlt, bei 
der Modellbildung keine Berücksichtigung finden können. Dies ist allerdings nicht 
nur aus Effizienzüberlegungen erforderlich, sondern auch um die Akzeptanz des 
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betroffenen Personal bei der Realisierung einer solchen Vorgehens weise zu 
erreichen. 

Ein weiterer wichtiger Punkt sind die sich ergebenden Einflüsse auf die 
Arbeitszeitregelungen. Da der Fahrzeugeinsatz mit der Einteilung der Ladecrews 
synchronisiert werden muss, ergibt sich zwangsläufig eine Flexibilisierung der 
Arbeitszeiten, d.h. die bisher genutzten statischen Schichtmodelle können nicht 
mehr zur Anwendung kommen. Grundlage für ein flexibles Arbeitszeitkonzept 
kann die Einsatzplanung bei der Leistungserstellung im Bereich des öffentlichen 
Personennahverkehrs sein, wo im operativen Bereich traditionell eine bedarfs- 
angepasste Festlegung der Arbeitszeiten des Fahrpersonals erfolgt 

Neben den Veränderungen bei den (operativen) Planungsabläufen ergeben sich 
bei einem derartigen Konzept weitere Anforderungen im Dispatching, da sich der 
Koordinationsaufwand zwangsläufig erhöhen wird. So ist ein effizientes Informa- 
tionsmanagement erforderlich (s. u.a.[4]), um auf der Basis online erfasster 
Betriebsdaten eine leistungsfähige Steuerung und Überwachung der Abläufe 
gewährleisten zu können. Dies bezieht sich in erster Linie auf eine zeitgenaue 
Bereitstellung der Ladecrews, die bei Dienstbeginn bzw. nach Abschluss eines 
Sammelvorgangs entweder direkt von einem Leerfahrzeug an einem definierten 
Punkten übernommen werden oder aber mit einem anderen Fahrzeug zu dem 
nächsten Einsatzpunkt (bzw. bei Dienstende zurück zum Depot) transportiert 
werden (Taxi-Trip). Aufgrund der verfügbaren Informations- und Kommu- 
nikationstechnologie (Standorterfassung der Fahrzeuge über satelliten-gestützte 
Ortung, Online-Erfassung von Fahrzeugdaten, etc.) sind die notwendigen (tech- 
nischen) Voraussetzungen für das erforderliche Dispatching gegeben. 



4 Zusammenfassung und Ausblick 

Die notwendigen Veränderungen in der (kommunalen) Entsorgungswirtschaft 
erfordern in verschiedenen Bereichen ein tiefgreifendes Umdenken in der 
Gestaltung der logistischen Prozesse. Mögliche Ansätze bestehen, neben Maßnah- 
men auf der (fahrzeug-)technischen Ebene, in einer effizienteren Touren- und Per- 
sonaleinsatzplanung, die mit vorhanden quantitativen Methoden realisiert werden 
kann. Verbunden hiermit sind allerdings auch verschiedene Maßnahmen im orga- 
nisatorischen Bereich, die zwangsläufig erhebliche Veränderungen der vorhan- 
denen (betrieblichen) Strukturen zur Folge haben werden. 

Im Vordergrund steht hierbei, neben der Aufhebung der festen Zuordnung von 
Fahrern und Ladecrews, die Flexibilisierung der Arbeitszeiten. Außerdem ergibt 
sich im operativen Bereich für den Ladecrews eine Erhöhung der produktiven 
Arbeitszeitanteile, die zwangsläufig zu Personaleinsparungen führen. Allerdings 
entsteht im Bereich der Planung und des Dispatchings auch ein zusätzlicher Per- 
sonalbedarf, allerdings in einem geringeren Umfang, da es hier zu einem deut- 
lichen Ansteigen des Aufgabenumfangs kommt. 

Bei einer Durchsetzung derartiger innerbetrieblicher Veränderungen muss mit 
Sicherheit in vielen Fällen mit erheblichen Widerständen gerechnet werden, da 
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insbesondere in den durch kommunale Gebietskörperschaften beherrschten Unter- 
nehmen die Akzeptanz wettbewerblicher Strukturen (weitgehend) fehlt. Außerdem 
zeigen sich immer wieder Bestrebungen nach einer möglichst weitgehenden 
Besitzstandswahrung, die notwendigen Änderungen entgegenstehen. Um aller- 
dings in einem deregulierten Markt zukünftig bestehen zu können, müssen die 
möglichen Verbesserungsmaßnahmen umgesetzt werden, um langfristig die Kon- 
kurrenzfähigkeit am Mark gewährleisten zu können. 
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Abstract. Crew pairing, the creation of anonymous lines of work, is a crucial part 
of the crew airline planning process. Column generation with shortest path pricing 
subproblem provides high quality solutions. In its basic form, the pricing subprob- 
lem relies on assumptions, such as additivity of the cost function and constraint 
contributions. However, it is not possible to be assume that these requirements 
are satisfied, particularly if the pairing system gives the user control over problem 
formulation and maintenance. 

Solutions to these challenges are proposed, based on proper granularity of the 
subproblem, a /^-shortest paths based pricer and the application of resources to 
model nonadditive costs. Furthermore, a label-merging technique provides signifi- 
cant performance improvements. 



1 The Pairing Problem 

The pairing problem consists of creating anonymous sequences of flight legs 
(pairings), so that the coverage requirement of each leg is fulfilled. Each 
pairing is required to start and end at the same homebase airport and satisfy 
legality constraints (rules). The rules are often of a complex structure and 
vary from airline to airline. 

Pairing costs consists mainly of salary, per diem compensation, hotel costs 
and artificial penalties introduced to reward some characteristics of the pair- 
ings. The resulting cost function is in general nonadditive. The optimisation 
problem is to minimise the sum of all the pairing costs. 

1.1 Approaches Survey 

The pairing problem can be formulated as a set-covering problem. Solving 
this problem to optimality requires explicit enumeration of all legal pairings, 
which is computationally very expensive due to the very large number of legal 
pairings. 

The problem can instead be solved approximately by an iterative ap- 
proach. In each iteration the previous solution is used as a starting point. 
New pairings that are similar to the pairings in the previous solution are 
generated and the iteration is concluded by solving a set-covering IP prob- 
lem with pairings from the previous solution and the newly generated ones. 
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Various heuristic strategies are used in the generation step, for example time- 
windowing. This is known as the generate and optimise approach. Further 
details can be found in [2]. 

Another widely used technique, column generation, is based on the idea of 
solving the LP-relaxation of the original problem. New pairings with negative 
reduced costs are generated by solving the pricing subproblem. If the pricing 
subproblem is solved optimally, this method will find the optimal solution to 
the LP-relaxation. 

An early application of column generation to the pairing problem is due 
to [7], in which it is shown that columns can be priced by solving a shortest 
path problem on a network with arcs representing legs and overnight connec- 
tions. In the airline industry the sequence of legs flown in a working day is 
known as a duty period , and for many rules the legality of a single duty period 
is independent of preceding or succeeding duties. This additional structure 
is exploited in [5] where a duty period network is formed in which nodes are 
duty periods with state information, and arcs represent legal overnights. 

Results for flight and duty based implementations are presented in [8]. 
In both versions, resources (labels) are added to each node to track legal- 
ity conditions, and a resource constrained shortest path problem is solved. 
Comparisons between the two versions show that flight based implementa- 
tion generally spends more time in the pricing routine. However, the duty 
version cannot solve as large problems as the flight version due to memory 
limitations. 

The problem of the size of the duty network is addressed in [4]. A relaxed 
duty network with a significantly smaller number of arcs is introduced. This 
has a positive impact on memory consumption as well as the time spent in the 
pricing routine. A refinement scheme for the duty network (partial reversing 
of the relaxation) is proposed. 

In the next sections we will build on top of the framework proposed by [4] 
by extending the class of modelled rules and cost functions. In section 2 we 
show how some results can be achieved by the proper design of the network 
topology. Some more complex rules and costs require modification of the 
pricing subproblem solver, as shown in section 3. 

2 The Solution Method 

2.1 Rules and Costs, their Structure and Evaluation 

Carmen Systems provides a rule modelling language (Rave) that permits 
planners to easily add and modify the rules and the cost function. Rave is a 
black-box system, able to evaluate expressions on chained legs and deciding 
whether a chain is legal with respect to the rules. However, it does not expose 
the internal details of the evaluation process to the rest of the system. 

The structure of the rules and costs has significant impact on the pricing 
process. For modelling purposes the sequence of legs is usually grouped into 
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Fig. 1. Hierarchy of chain levels 



the hierarchy of levels, as shown in the figure 1. In the pairing problem, there 
is usually only one intermediate level of duties between the atomic level of 
the legs and the top-most level. 

An important concept is the range of objects that evaluated expressions 
depend on. For example, an expression returning “block time of current duty” 
has range of one duty. An expression determining the length of the pairing 
in terms of days has chain range. 



2.2 Network Model 

The pricing routine, as proposed by [7] , finds a pairing with negative reduced 
cost as a shortest path in the network. This basic approach relies on the 
additivity of the cost function and the legality of the pairings corresponding 
to the path in the network. 

These assumptions are very seldom satisfied entirely, so [4] proposes to 
introduce a fc-shortest path (k- SP) based pricing subproblem solver. In this 
design, the pricing routine works by first calculating the shortest path tree 
for the network. This returns the cheapest path in the network. If the cost is 
nonnegative, there are no attractive pairings, and the pricing routine termi- 
nates. 

If the path has a negative reduced cost estimate (which is obtained by 
summing up the arc costs), the rule system is called to see if the correspond- 
ing pairing is legal, and if it also has negative reduced cost. If so the pairing 
is added to the LP, and the pricing routine can either terminate, or continue 
producing attractive pairings. If the pairing is illegal, or does not have nega- 
tive reduced cost, then the pricing routine finds the next shortest path, and 
repeats the tests. This continues until one of the above termination criteria 
is satisfied, or all paths are enumerated. 

As mentioned in [4] and [5], the fact that the majority of the pairing 
rules have range of one or two duties can be exploited to design an efficient 
pricing routine. Approximate additivity of the cost function with respect to 
the duties and duty-duty connections reduces the frequency and magnitude 
of cost estimation errors as well. 
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2.3 Network Topology 

The network is designed to model completeness criteria (a pairing has to start 
and end at the same base), maximum length of the pairing in calendar days 
and nonadditive penalty dependent on the length of the pairing. 

This is illustrated in figure 2. There are multiple source and sink nodes, 
one for each calendar day and homebase combination. A separate k - SP pric- 
ing is performed for each starting node, and the search is restricted to paths 
leading to the corresponding homebase within a specified number of days. 
This way the maximum length of the pairing and the completeness rule is 
satisfied. Arcs between the sink nodes and the “master sink” node model 
calendar length penalty. 



source nodes 




the master sink 



duty arcs 

duty-duty connections 

source and sink node connections 

sink nodes to super sink node connection 

Fig. 2. Overview of the network model 



3 Extension to the Network Model 

The basic network model gives the foundation for a successful combination of 
column generation with a black-box rule system. However, for some classes of 
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problems the cost estimation errors and the rule failures can severely impact 
the performance or the solution quality. Here we present how one such class 
of problems can be modelled in the network and how this change affects the 
fc-SP routine. 



3.1 Resource Dependent Cost Elements 

The resource constrained shortest path problem has traditionally been used 
as a subproblem in applications of column generation to scheduling problems. 
The technique can be extended to model some classes of nonadditive costs as 
well. 

Let us assume that cost of a pairing can be written in the form c(p) = 
c a {p) + c n (r(p))i where c a (p ) is additive with respect to the duties and duty 
connections. c n (r(p)) is the nonadditive part dependent on additive resource 
vector r(p). 

Not every nonadditive cost can be modelled using resources. The resource 
must be a additive function. Furthermore, the nonadditive part of the cost 
c n is required to be nonnegative and nondecreasing with respect to the value 
of the individual resources. 

In practise, c n may depend also on some other characteristics of the path 
that can be determined directly from the network, such as starting day of the 
pairing (given by path’s source node) or the length in calendar days. Some 
examples of costs modelled by resources: 

• Penalise pairings for which the flight time exceeds 480 minutes by con- 
stant value of 4000 cost units. 

• Penalise pairings for number of the short night stops (< 6 hours). One 
short night-stop is not penalised, two or more short night-stops are pe- 
nalised by 500. 



Modification of the Network and the k — SP Algorithm for Use 
with the Resources 

The network model is modified in such a way that additive part c a of the 
reduced cost is kept on the arcs instead of the original reduced cost c. In 
addition, arc resource consumption vector r(p) is stored in the graph as well. 

The pricing subproblem consists of finding any attractive pairing (with 
negative reduced cost c(p) = c(p) — 7 tA). However, it is preferable to find 
several attractive pairings in one pricing iteration. 

If there are no resources, the k - SP algorithm achieves this by enumerating 
all paths in ascending order with respect to the reduced cost. It stops after 
encountering the first non-attractive path, at which point all attractive paths 
have been found. 

With resources, a nonadditive pricing subproblem needs to be solved and 
the fc-SP algorithm can not guarantee that the generated paths are ordered 
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by their reduced cost, as illustrated by the example in figure 3. In the ex- 
ample pricing subproblem the cost function is the sum of a additive cost 
and a nonadditive part c n depending on one resource. Let us assume, that 
c n (r(p)) = 0 if r(p) < 70 and c n (r(p )) = —5 otherwise. 
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Fig. 3. Impact of the resources on the fc-SP algorithm 



Even though the cost of the path p\ is —2 -f c n (50) = —2 and cost of the 
path p 2 is 2 -j— c n (30) = 2, we cannot say that p\ is definitely better than p 2 , 
since c(pi o p s ) = -5 + c n (80) = 0 > c(p 2 o p s ) = -1 + c n (60) = -1. 

Attractive paths could be found by enumerating all paths from the source 
to the sink node. However, this process is obviously very inefficient. In order 
to reduce the number of generated paths, we search for the set of Pareto- 
optimal paths from the source to the sink node. 

Definition 1. The path p is said to be dominated by path p', if c a (p) > c a (p') 
and Tj (p) > rj(p f ) for every resource Tj. 

Definition 2. Let P(n s ,n) be set of all paths from the source node to node 
n. A path is called Pareto-optimal , if it is not dominated by any path in 
P(n 8 ,n). 

If the set P(n s ,nd) of paths from the source node n s to the sink node 
nd contains at least one attractive path, then it contains also at least one 
attractive Pareto-optimal path. This means that the pricing subproblem is 
guaranteed to be solved by this approach. 

A modification of the algorithm due to [3] is used to find the set of the 
Pareto-optimal paths. An important property of the Pareto-optimality is the 
“principle of optimality” , meaning that the subpath to an intermediate node 
in the network, which is not Pareto-optimal, cannot be part of a Pareto- 
optimal complete path to the sink node. This allows us to discard dominated 
subpaths in the early stages of the network and to significantly reduce the 
computational effort. 

Pareto-optimal subpaths to each node are enumerated in increasing lex- 
icographic order with respect to c a and vector of resources r(p). The fc-SP 
terminates after encountering the first path to sink node with c a > 0. 

Label Merging 

Due to frequent rule failures and underestimates, the fc-SP routine can spend 
very long time in certain parts of the network until it finds the attractive pair- 
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ings. These problems might be resolved in later stages thanks to a refinement 
of the duty network. However, it is preferable to focus the search effort to 
those parts of the network, which are more likely to produce attractive legal 
rotations. 

A simple adaptive technique can be used to regulate the number of gener- 
ated non-dominated paths in the network by over-restricting the dominance 
with the obejctive to dominate a larger number of paths which are represented 
by a “merged label (path)”. 

Path p is said to be dominated by path p f if c a (p) + K a (^s) > c a (p') and 
r (i)(p) _j_ ftO’)(n s ) > r^\p') for each resource r^\ where tt a (n s ), K^\n s ) are 
parameters depending on the current source node n s . Parameters K a (n s ) and 
K^\n s ) are adaptively changed after every pricing iteration, depending on 
the time spent in a pricing routine for source node n s . 



4 Results 

The extensions to the network model and pricing subproblem solver men- 
tioned in section 3 were successfully used in a commercial production system 
developed by Carmen Systems. 

The improved modelling capabilities have been tested on several problem 
instances of our clients and we observed significant performance improve- 
ments. Figure 4 depicts the effect of using the resource modelling and label 
merging on a pairing problem from KLM. The graph shows that using both 
new features in the pricer can reduce runtimes by up to 80% on some exam- 
ples. 



5 Summary 

By extending the duty-network approach in [4] we have developed a flexible 
column generator system able to handle wide variety of cost and rule struc- 
tures while maintaining the black-box paradigm of flexible rule modelling 
language. In order to better support this flexibility, more sophisticated net- 
work algorithms employing resource modelling and label merging were used 
for solving the pricing subproblem. 
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Fig. 4. Behaviour of column generator resource modelling 
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Abstract. In an earlier paper, we have demonstrated that traffic equilibria un- 
der social marginal cost tolls can be computed as local optima of a nonconvex 
optimization problem. The nonconvexity of this problem implies in particular that 
linearizations, e.g. in the Frank- Wolfe method, do not give underestimates of the 
optimal value. In this paper we derive the convex hull of nonconvex arc cost func- 
tions of BPR type. These convexifications can be used to get underestimates of the 
optimal value, or to get better search directions in the initial phase of the Frank- 
Wolfe method. Computational results for the Sioux Falls and Stockholm networks 
are reported 



1 Overview 

Traffic in large cities is today a major problem for society. It has become 
a common standpoint among transportation planners that it is necessary to 
charge some kind of fees, congestion tolls, for the usage of the crowded streets. 
Classical social marginal cost pricing theory for road traffic ([1], Ch. 4) states 
that if each user is charged a toll equal to the total value of time loss incurred 
on other users of the network, this will induce an equilibrium that is system 
optimal (i.e with minimal total travel time), assuming that all users have a 
fixed and identical time value. 

However, different traveller groups typically have radically different time 
values. Therefore, computed tolled equilibria need to recognize the variation 
of time values between user groups, thus leading to multi-class user equilibria, 
(e.g„ [2], [8], [4]). 

Introducing tolls in this multi-class setting, one would like the tolls to 
induce an equilibrium that minimizes not the total travel time but rather the 
total value, V , of travel time as perceived by the users. 

In previous papers ([3], [4]) we have shown, that introducing social marginal 
cost (SMC) tolls will lead to equilibria that do not necessarily minimize V. 
However, they come close in that they turn out to be points fulfilling necessary 
conditions for local minima of V (over the set of feasible flows). However, V 
turns out to be nonconvex, implying that there may be many such equilibria. 

These equilibria would typically be determined by attempting to minimize 
V, e.g. by the Frank- Wolfe method. The nonconvexity of V, however, implies 
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that one cannot compute lower bounds to the objective by linearizations, as 
for convex problems. Hence one has no measure of the quality of an achieved 
solution. 

In the current paper we partly overcome this problem by constructing the 
convex hull, convV of V. Minimizing convV , or using classical Frank- Wolfe 
bounds for convV , will give us lower bounds for V. 

Moreover, using convV , rather than V, in the initial phases of the mini- 
mization may be favorable, compared to pure Franke- Wolfe iterations. 

2 Multi-Class User Equilibria 

Consider a road network consisting of nodes n e N and directed links a G A. 
Let P C N x N be the set of OD pairs. Assume that OD demands q £ between 
the OD pairs p e P for each user class k £ K are given and that to each link 
a are associated continuously differentiable cost functions — ► 9i+, 

that give the cost of traversing link a for a user in class k dependent on the 
class specific volumes on the link. For the time being, is a general function, 
but it will be endowed with a special structure in the next section. 

Let R p be the set of routes connecting OD pair p and R = U P epR p , the 
set of all routes. Let H = {h £ : J2 r eR p ^ r — Q P ^P £ -P, fc 6 K} 

denote the set of feasible route flow vectors, and let 

F = {/ € 5 K* xK : f k = Er€R S rah k r ,Va e A,k e K,h e H}, be the set of 
feasible link flows, where S ra is 1 if route r traverses link a, 0 otherwise. 

Definition 1. (extended Wardrop) h E H is a multi-class equilibrium flow if 
for any OD-pair p and user class fc, the class specific costs of routes actually 
used (i.e. having h ^ >0), are equal and not larger than those of any unused 
routes. 

Similarly to the single user class case (see [6], Thm 3.14), the equilibrium 
condition can be written as a variational inequality in the set of link flows 

<c(/),/ — /)> o V/€F (1) 

where c = (c£ ) a eA,k€K , (see [4]). 



3 Equilibria under Social Marginal Cost Pricing 

For space reasons this section is quite terse; for more details, see [3]. In the 
remainder of the paper, it is assumed that the drivers’ perceived link travel 
cost consists of two components: the toll p a and the travel time £ a , which is a 
twice differentiable function of the total link volume fl ot = fa - Using 

class specific time values Vk > 0, the perceived travel cost can be expressed 
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either in time or in monetary terms. Thus we define generalized time t k and 
generalized cost c k of link a for class k respectively as 

%(fa) = taifa 1 ) + Pa/Vk, (2a) 

Caifa) = Vkt a (fl 0t ) + Pa- (2b) 

Under SMC pricing, the users have to pay for the delays they incur on 
other users and one is interested in the traffic volumes that are established in 
the network and the corresponding toll values. The link toll then is the sum 
of all delay values for the users of the link caused by a marginal user, i.e. 

Pa=Pa{f) = t' a {f t a 0t )Y, V *f«- ( 3 ) 

k 

The SMC equilibrium problem can now be formulated as the VIP (1) 
with link cost functions defined by inserting (3) into (2a) or (2b). Using the 
costs c k = c k (but not i k \ See [3], [4]), the VIP (1) corresponds to a necessary 
condition for a local minimum over F of the total perceived value of travel 
time , 

n/) = E^(/« 0t )E^/a’ ( 4 ) 

a k 

since it has the property that W (/) = c(/), ([3], [4]). 

In general, V (/) is not convex and multiple SMC equilibria corresponding 
to different values of V can exist ([3], [4]). 



4 The SMC Equilibrium Problem 



According to the previous section equilibria (in the link flow space) can be 
determined by minimizing V (/) over F. Introducing w a = f k v k this 
problem can be stated 

V(f) = E^(/a 0t ) 



min 

f,w,h 






S.t. < 



Qp 



( f tot — f & 

I Ja 2-^k Ja 

fa = Er S *rK 

Wa = Efe vk fa 

E r€R p ~ 1 

>r >0 

Using C a (f,w) = d f t a {f) -w, we have V(f) = J2 a C a(f! l ot ,w a ). We will 
analyze C a , dropping the subscripts a for convenience. Thus let 
C(f,w) = t(f) • w with gradient VC = (t f (f)w,t(f)) and hessian 
't(f)w t'{fY 

t'(f) o 



V 2 c = V(VC T ) 



Assuming t" (f)w > 0 and t'(f) > 0 (which is natural) this implies that 
V 2 C has one negative and one positive eigenvalue (as is easily checked). 
Hence C is generically nonconvex. 
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Let v and v be respectively the smallest and largest values of Vk, k G K. 
Then, with / denoting /* ot , we have 

w = w a = J2 Vkfa < E vfa = v ■ /*"* = ?)/ and symmetrically w > vf. 
Thus, one may think of C as defined on the cone K = {(f,w)\vf < 
w < vf, f > 0} bounded by two rays, L = {(/, w)\w = vf,f > 0} and 
L = {(/, w)|m> = vf, f > 0} 



5 Convexification of C 

We will construct the convex hull, convC , of C on K. ConvC is the largest 
convex minorant to C ([7], Ch. I) 

We will perform this convexification for the commonly used travel times 
t(f) of BPR type, i.e. t(f) = to+b-f c , where to is the free flow time, and b and 
c are appropriate positive constants. The convexification can be performed 
in a similar way for other functional forms. With such travel times, C can be 
written 

C(/, w) = tow + bf c w , or, introducing C(f , w) —df f c w , 

C(f, w) = t 0 w + b • C(f, w). 

Since tow is an affine function, convC {f, w) = tow +b -convC (f, w). Hence, 
it is enough to find convC. C has the hessian 

which also has one positive and one negative eigenvalue, implying that C 
locally is concave in some direction at each nonzero point (/, w) G K. For a 
given point (/, w) in K we have ([7] Cor. 17.1. 5) 
convC (f ,w) - inf\ it f itWi {J2\C(fi,Wi) \_ 

£ Aj = 1, \i > 0, (fi, Wi) e K, A ifi = = 10} 

However, C(f, w ) = f c • w > f c+1 ■ v, implying that C(f, w) — » oo when 
/ — > oo in K. Hence the infimum above can be exchanged for a minimum: 
convC (f,w) = min{^\ i C(fi 1 w i )\'52\i = 1, 

A > 0 L (fiWi) G K A ifi = f,J2^i w i = ™} 

= Y!^iC(fi,Wi) for appropriate > 0, summing to 1 and ( fi,w% ) G K 
By the local (directional) concavity of C , no point ( fi,Wi ) can belong 
to intK , the interior of K. If this were the case, we could exchange ( fi,Wi ) 
for a pair ( fi,Wi ) ± ( df,d w ), with weights Äf/2, where ( df,d w ) is a direc- 
tion of concavity at ( fi,Wi ). This would give a lower value to XI A %C{fi,Wi) 
contradicting that it is minimal. 

Hence all ( fi , wi) belong to L or L. But along L and L , C is strictly convex, 
whence the minimum is achieved for a single point each on L and L (Fig 1). 
We have proved 

Proposition 1 For (/, w) G intK , 

convC(f,w) - inf {(1 - A)C(/i, vfi) + XC(f 2 , vf 2 )\ 

A, Jl 
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L 




Fig. 1. Construction of convV 



fi> 0, A 6 (0, 1), / = (1 — A)/i + A/ 2 , w = (1 — X)vfi + Aü/ 2 } 

To determine the exact form of convC , we will construct it in the following 
way. We take an arbitrary point (f,vf) on L. Through the corresponding 
point P = (f,vf,C(f,vf)) on the graph of C on L we construct a tangent 
plane to that graph. We then rotate the tangent plane until it touches the 
graph of C on L at some point Q. The line segment from P to Q will then 
lie in the graph of convC. 

The details of this construction is given [5]. We give the result. 
Proposition 2 convC(f,w ) = t$w + bh((f,w)g) where 
h{x) — v • ( x/(v — v)) c+1 and 
g — (v(p c — 1), 1 — l/p) T , with p = (ü/u) 1 /^ 1 ) 

Corollary 

V convC = ((Mo) + bh'((f, w)g)g T 
S7 2 convC = bh"((f, w)g)gg T . 

Proof By direct differentiation. □ 

Letting f a = ( /„ )fceir be a column vector, we have /* ot = J2kfa= &T fa, 
with e T = ( 1 , 1, 1 ), and w = Vkfa = yT fa ■ Thus, with e = (e, v), 

/J g = fl ( e , v ) = (/Je, /J v ) = ie T fa, v T f a ) = (/« ot , w a ) (2) 

Let V a {fa) = t a (fl ot )-Y, Vkfa be a generic term in V (/). Then convV (/) = 
convVa(fa) since the terms have disjoint sets of variables. Further, V a (f a ) — 
Ca((f a 0t ,W a ) T ) = C a (e T f a ) 

Hence, convV a (f) = convC a (e T f a ), whence convV (f) — convC a (e T f a ) 
Using the above relations (2), we can now evaluate the derivatives of 
convV a w.r.t f a : 

convVa(fa) = convC a(e T f a ) = (0, t°)e T fa+bh(g T e T fa) = i%f a +bh(g T f a ), 
where = (0, t°)e T and g T = g T e T 
Thus 

VK =^ a + bh>(g T f a )g T and 
V 2 K = bh"(g T f a )gg T . 
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6 Some Experimental Results 

We have applied our results to two test cases, the classical Sioux Falls network 
(24 nodes, 76 links, 528 OD-pairs) and a study of Stockholm (1250 origins, 
19539 links). The Stockholm case has three user classes (work, business, oth- 
ers) with time values (.98, 3.30, .19) and global fractions (.754, .036, .210). In 
Sioux Falls we used these same time values and applied these same fractions 
for all OD-demands. 

The use of convexification may be threefold 

a. getting a valid lower bound, 

b. determining a promising starting point, and avoiding getting trapped 
in a bad local optimum, by initially minimizing convV , and finally 

c. (related to the previous point) possibly achieving faster initial conver- 
gence by minimizing convV instead of V. 



6.1 Sioux Falls Network 

Previous runs ([4]) with Frank- Wolfe on V (in a Matlab environment) indicate 
that V has only one local, and hence global, optimum. Hence usage point b 
is not relevant here. 

The lower bounds for V and convV , achieved by long runs are 63.810 and 
46.719 respectively. Hence, the convexity gap is discouragingly large. 

In Figure 2 we display on the one hand (2b) how the relative errors develop 
with the iterations when minimizing V and convV respectively, and, on the 
other hand (2a) the errors for V when minimizing V and convV respectively. 
It is interesting to note that for iterations 15-70 we achieve better points for 
V, when minimizing convV. In the early iterations, however, minimization 
of convV is not beneficial. 

The relative errors are determined as ( V (f^)— LB D) / LB D (where LBD 
is the linearization bound at iteration i = 10000), and correspondingly for 
convV. 



6.2 Stockholm 

Stockholm is a rather large case, and the iterations are heavy. We have imple- 
mented the Frank- Wolfe method for minimizing V and convV using macros 
in EMME/2. 

The case concerns the potential addition of a major eastern bridge/tunnel 
system connecting the north and south parts of the city (otherwise separated 
by water). The comparison is made with and without SMC tolls, giving in 
total 4 cases. For Stockholm the convexity gaps are much smaller (on the 
order of 3 %) as can be seen in Table 1. 
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Fig. 2. Iteration histories of SMC calculations a. (left) rel errors for V, minimizing 
V or convV , and b. (right) rel errors for V and convV 





Without bridge/tunnel 


With bridge/tunnel 


Without tolls 


5.176 


5.078 


With tolls 


5.119 


5.035 


Lower bound 


4.950 


4.890 



Table 1 Results for Stockholm (societal cost in MSEK/h at busy hour). 



Concerning uses b and c, minimization of convV instead of V seems worth- 
while, leading to smaller relative errors in the beginning (Fig. 3). So for the 
production runs, we start with minimizing convV for the first 10 iterations, 
then switching to V. The Stockholm case has been too heavy to allow us to 
study the existence of multiple local optima (usage b) 
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Rel errors for V 




Fig. 3. Rel. errors for V for Stockholm, minimizing solid: convV , dashed: V 
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Zusammenfassung Während für Fahrgemeinschaften auf Langstrecken häufig 
einfache Vermittlungsverfahren ausreichen, kann und muss die Vermittlung von 
Fahrgemeinschaften auf Kurzstrecken als Online- Optimierungsproblem dargestellt 
werden. Ausgehend von einer Einordnung des als ganzzahliges lineares Programm 
formulierten Problems in ein Klassifikationsschema für Tourenplanungsprobleme 
werden hier heuristische und exakte Lösungsalgorithmen vorgestellt, die einerseits 
die Anwendbarkeit unter praktischen Online- Bedingungen ermöglichen, aber - man- 
gels geeigneter Standard-Benchmarks - gleichzeitig auch eine Bewertung der Qua- 
lität der Lösungen erlauben. 

1 Einleitung 

Eine Vielzahl realer logistischer Problemstellungen lassen sich als Touren- 
planungsprobleme (Vehicle Routing Problems, VRP) [3] modellieren. Auch 
die Vermittlung von Fahrgemeinschaften im Berufsverkehr kann als ein spe- 
zielles VRP angesehen werden. Während in der Praxis für die Vermittlung 
von Fahrgemeinschaften auf Langstrecken häufig Ansätze, die auf einfachen 
Datenbankabfragen basieren, erfolgreich sind, gilt dies für Vermittlungen im 
Berufsverkehr nicht, da hier deutlich höhere Anforderungen an die Einhal- 
tung räumlicher und zeitlicher Abhängigkeiten gestellt werden. In diesem 
Beitrag wird der im Fahrgemeinschaftsvermittlungssystem der Universität 
Oldenburg 1 gewählte Ansatz in Hinblick auf die Modellierung des Vermitt- 
lungsproblems als VRP und die verwendeten Algorithmen beschrieben. Einen 
Überblick über das Gesamtsystem liefert [8]. Während der Entwicklung die- 
ses Systems sind ähnliche Ansätze wie etwa M21 [5] und PTV RideShare [6] 
entstanden. Auch hier wird die Vermittlung von Fahrgemeinschaften als Tou- 
renplanungsproblem aufgefasst und mit entsprechenden Algorithmen gelöst. 

2 Problemeigenschaften 

Tourenplanungsprobleme treten in einer Vielzahl von Variationen auf. Daher 
soll das hier behandelte Problem mit Hilfe eines Klassifikationssystems nach 

* gefördert durch die Deutsche Bundesstiftung Umwelt (DBU) 

1 siehe www.fgm.uni-oldenburg.de. Geplante Aufnahme des Betriebs im Oktober 
2003. 
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Domschke [3] eingeordnet werden. Bei der Vermittlung von Fahrgemeinschaf- 
ten werden Anfragen als Angebote von und Gesuche nach Fahrgemeinschaften 
betrachtet. Beide Arten von Anfragen haben gemeinsame Eigenschaften: 

• jeweils einen Startort sowie einen Zielort; 

• neben dem eigentlichen Startort können weitere alternative Aufnahme- 
punkte (etwa Parkplätze an Autobahnauffahrten) existieren; 

• Zeitfenster sowohl für den Start- als auch für den Zielort, die nicht verletzt 
werden dürfen; 

• Assoziationen zwischen Hin- und Rückfahrt wegen alternativer Aufnah- 
mepunkte. 

Ein Angebot stellt jeweils ein Fahrzeug mitsamt Depot mit folgenden Eigen- 
schaften zur Verfügung: 

• fahrzeugspezifische Kapazität (i.d.R. zwischen 2 und 5 Personen); 

• Routen dürfen keine längeren Umwege enthalten, als vom Fahrer toleriert; 

• Mindestmitfahrzeiten; 

• Via-Punkte, die auf der Route liegen sollen. 

Außerdem kann ein Fahrer angeben, ob er ggf. auch an einer anderen Fahrge- 
meinschaft als Mitfahrer teilnehmen möchte. Neben diesen auf Fahrzeuge und 
Routen bezogenen Eigenschaften können sich Nutzer des Systems gegensei- 
tig bewerten und bestimmen, dass sie mit bestimmten anderen Nutzern keine 
Fahrgemeinschaften bilden möchten. Abbildung 1 enthält ein Beispiel für die 
Tourenstruktur. 




Abbildung!. Beispielszenario 



Gesucht wird eine Zusammenstellung von Fahrgemeinschaften, die zum 
einen die insgesamt zurückgelegte Wegstrecke minimiert und zum anderen 
für in der Summe möglichst positive gegenseitige Bewertungen der Fahrge- 
meinschaftsteilnehmer sorgt. Daneben sollen möglichst viele Gesuche vermit- 
telt werden. Diese Problemeigenschaften lassen sich auf ein formales Opti- 
mierungsproblem, das als gemischt ganzzahliges lineares Programm (Mixed 
Integer Programm, MIP) [7] vorliegt, abbilden. 




151 



In dem von Domschke [3] vorgeschlagenen Klassifizierungssystem lässt 
sich das Fahrgemeinschafts Vermittlungsproblem wie folgt charakterisieren: 

[p , task, p/d, tw, sei | cap j , dur j | dir , K /F | L] 

Hierbei beschreibt das 4-Tupel [a|/ 3 | 5 | 7 ] die verschiedenen Problemcharakte- 
ristiken. a steht für die Depot- und Kundencharakteristik, ß für die Fahr- 
zeugcharakteristik, 5 für die Problem- öder Zusatzcharakteristik und 7 für 
die Zielsetzungen. Im einzelnen bedeutet dabei: 

Depot - und Kundencharakteristik 

p Es gibt p Depots, nämlich die Startorte der Fahrgemeinschaftsan- 
bieter. Zu diesen Depots muss nicht zurückgekehrt werden, 
task Die zu befördernden Güter - hier Mitfahrer - werden an einem 
bestimmten Ort aufgenommen und an einem anderen wieder ab- 
gesetzt. 

p/d Keine reine Belieferung oder Abholung 
tw Harte Zeitfenster für Abholung und Belieferung 

sei Nicht alle Kunden müssen bedient werden. 

Fahrzeug Charakteristik 

capi Fahrzeuge mit unterschiedlichen Kapazitäten. In der Regel zwi- 
schen 2 und 5 Plätzen. 

dur^ Maximale Tourdauer pro Fahrzeug beschränkt durch Umwegeto- 
leranz 

Problem- oder Zusatzcharakteristik 
dir gerichteter Graph 

K/F Nicht jeder Kunde kann durch jedes Fahrzeug bedient werden, da 
Kunden andere Kunden ausgeschlossen haben könnten. 

Zielsetzungen 

L Minimierung der zurückgelegten Entfernungen 

Einige Problemeigenschaften lassen sich durch obiges System nicht aus- 
drücken. So ergibt sich als zusätzliche Fahrzeugcharakteristik, dass Fahrzeuge 
nicht zu ihren Depot zurückkehren und nicht warten können, bis ein Zeit- 
fenster eingehalten wird. Die Existenz alternativer Aufnahmepunkte führt 
einfache Umladevorgänge ein. Durch die möglichen Bewertungen ergibt sich 
außerdem eine weitere Zielsetzung. 

Da das Fahrgemeinschaftsvermittlungsproblem innerhalb eines Online- 
Systems gelöst werden muss, ergeben sich weitere Rahmenbedingungen für 
die verwendeten Algorithmen. Zum einen sollten Ergebnisse innerhalb ge- 
wisser Zeitschranken sicher vorliegen - was keinen Einfluss auf die formale 
Problemdefinition hat. Zum anderen liegen zu lösenden Probleminstanzen nie 
vollständig vor, da sich fortlaufend Änderungen durch Benutzerinteraktionen 
ergeben. Da auf der Basis der zu einem bestimmten Zeitpunkt vorliegenden 
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Ergebnisse jedoch auch Vermittlungsentscheidungen getroffen und nach au- 
ßen kommuniziert werden müssen, die nicht wieder zurückgenommen werden 
dürfen, ist es nötig, Teile der Lösung fixieren zu können, was in der Problem- 
definition berücksichtigt werden muss. 

3 Lösungsalgor i t hmen 

Die verschiedenen Lösungsalgorithmen, die bisher entstanden sind, beachten 
jeweils die oben beschriebene Problemdefintion, was ihre Leistungsfähigkeit 
vergleichbar macht. Da die vorgegebenen Schranken für die Laufzeit der im 
Vermittlungssystem verwendeten Algorithmen aufgrund der Problemkomple- 
xität nur durch heuristische Ansätze sicher eingehalten werden können, zur 
Einschätzung der Qualität der Heuristiken aber auch Kenntnis über optima- 
le Problemlösungen nötig war, wurden sowohl heuristische als auch exakte 
Verfahren entwickelt. Diese werden in den folgenden beiden Abschnitten be- 
schrieben. 

3.1 Heuristische Verfahren 

Es existieren zwei Heuristiken: eine verhältnismäßig einfache Greedy-Heuris- 
tik sowie ein Tabu- Suche Verfahren. Die Greedy- Heuristik arbeitet in drei 
Schritten: 

1. Priorisierung der Gesuche 

2. Einfügen des wichtigsten Gesuchs in die am besten passende Fahrgemein- 
schaft 

3. Nachoptimierung 

Im ersten Schritt wird gemäß einiger statisch prüfbarer Kriterien, wie die 
grundsätzliche Kompatibilität der Zeitfenster oder wie mögliche Ausschlüsse 
anderer Teilnehmer, eine Reihenfolge ermittelt, in der versucht wird, die Ge- 
suche passenden Fahrgemeinschaften zuzuordnen. Dies geschieht dann im 
zweiten Schritt. Für jedes Gesuch wird geprüft, ob und wie gut es in eine 
der bisher konstruierten Fahrgemeinschaften passt. Dazu wird der optimale 
Pfad über die Orte, die von der Fahrgemeinschaft angesteuert werden, durch 
Enumeration mittels einfachen Branch&Bounds errechnet. Diese Strategie ist 
hier möglich, da Fahrgemeinschaftstouren nur eine begrenzte Länge aufwei- 
sen. Selbst vollbesetzte Pkw ergeben selten Pfade mit mehr als 10 Orten. 
Die Fahrgemeinschaft, die sich gemäß Umweg und der Bewertung der Fahr- 
gemeinschaftsteilnehmer untereinander am besten eignet, wird ausgewählt 
und das Gesuch dieser Fahrgemeinschaft fest zugeordnet. Diese Entscheidung 
wird gemäß der Greedy- Strategie im weiteren Verlauf nicht wieder verändert. 
Sind auf diese Weise alle Gesuche abgearbeitet, findet im dritten Schritt eine 
Nachoptimierung statt. Hier werden durch Austausch von je einem Mitfah- 
rer zwischen zwei Fahrgemeinschaften im Sinne eines 2-opt- Verfahrens mögli- 
che Verbesserungen ermittelt. Anzumerken ist, dass die Greedy-Heuristik die 
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Möglichkeit den Fahrer eines Angebots auch als Mitfahrer in eine andere 
Fahrgemeinschaft zu vermitteln nicht nutzt. 

Die Strategie für einzelne Fahrgemeinschaften bei bekannter Zusammen- 
setzung optimale Touren zu bestimmen, hat für den Betrieb in der Praxis 
einen wichtigen Vorteil: Die Mitglieder einer Fahrgemeinschaft werden nicht 
durch etwaige Artefakte der heuristischen Herangehensweise verstört. Die 
Entscheidungen des Systems, die die einzelnen Mitglieder überblicken können 
- nämlich die Zusammenstellung ihrer Fahrgemeinschaft -, sind immer opti- 
mal. Gründe für eine Abweichung vom Optimum liegen immer in der gewähl- 
ten Zuordnung der Gesuche zu den Angeboten. 

Eine zweite Heuristik, die nach dem Prinzip der Tabu-Suche [4] arbei- 
tet, erweitert den Ansatz der Greedy-Heuristik. Nach einer initialen Phase, 
die den ersten beiden Schritten des oben beschriebenen Verfahrens gleicht, 
findet eine schrittweise Verbesserung der Zwischenlösung statt. Als mögliche 
Veränderungsschritte dienen 

1. das Entfernen eines Mitglieds einer Fahrgemeinschaft und Einfügen in 
eine neue, 

2. die Auflösung der Fahrgemeinschaft eines Fahrer, der bereit ist, in einer 
anderen Fahrgemeinschaft mitzufahren und 

3. die Neugründung einer Fahrgemeinschaft, falls ein Fahrer bisher als Mit- 
fahrer fungiert. 

Der erste Schritt entspricht den einzelnen Veränderungen bei der 2-opt Nach- 
optimierung der Greedy-Heuristik. Er lässt sich durch doppelt Anwendung 
negieren. Die Schritte 2 und 3 führen zu einer Erweiterung gegenüber der 
Greedy-Heuristik. Sie lassen sich durch den jeweils anderen wieder zurückneh- 
men. Um den Aufwand, der zum Durchsuchen der gesamten Nachbarschaft 
einer Zwischenlösung nötig ist, zu verringern, wird eine Kombination der von 
Glover [4] vorgeschlagenen Strategien Aspiration- Plus und Elite- Candidate- 
List verwendet. 



3.2 Exakte Verfahren 

Da Heuristiken zwar gemäß der Problemdefinition gültige, aber nicht not- 
wendigerweise optimale Ergebnisse liefern, wurde auch ein exaktes Verfahren 
entwickelt. So kann überprüft werden, ob die Heuristiken eine ausreichende 
Qualität besitzen. Dieses Verfahren basiert direkt auf der Problemformulie- 
rung als MIP, während diese für die Heuristiken eher als Entwicklungsspezi- 
fikation gilt. 

Als Lösungsansatz dient hier die für Tourenplanungsprobleme übliche De- 
komposition in zwei Teilprobleme - dem Master- und dem Subproblem -, die 
durch einen Branch&Price- Algorithmus gekoppelt werden (siehe z.B. [2]). Das 
Master-Problem ist ein beinahe reines Set-Partitioning-Problem. Es gilt aus 
einer Menge von möglichen Fahrgemeinschaften, deren Struktur und Beitrag 
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zur Zielfunktion bekannt ist, diejenigen auszuwählen, die möglichst viele Kun- 
den bedienen und gleichzeitig die Zielfunktion minimieren. Bedingt durch die 
nötige Kopplung bestimmter Hin- und Rückfahrten, die zueinander passen- 
de Eigenschaften haben, existieren hier über das Set-Partitioning-Problem 
hinausgehende Nebenbedingungen. Das Master-Problem wird durch einen 
Branch&Bound- Algorithmus mit LP-Relaxation als unterer Schrankenfunk- 
tion gelöst. 

Das Sub- oder auch Pricing-Problem erbt annähernd alle Nebenbedingun- 
gen der originalen Problemdefinition. Es stellt ein Kürzeste- Wege-Problem 
mit Nebenbedingungen dar. Zur Lösung wird ein Algorithmus der Dynami- 
schen Programmierung eingesetzt. Die Kopplung des Subproblems an das 
Masterproblem führt dazu, dass die dualen Kosten der Nebenbedingungen 
einer Lösung der LP-Relaxation mit den Kantengewichten im Subproblem 
verrechnet werden. Dadurch können negative Kantengewichte und ebenfalls 
negativ bewertete Zyklen im Graphen entstehen. Diese Eigenschaften er- 
schweren die Lösung des Problems, da kein Label-Setting sondern ein Label- 
Correcting Algorithmus eingesetzt werden muss. Außerdem zeigt sich, dass 
sich gegenüber reinen Tourenplanungsproblemen wie dem klassischen VRP 
mit Zeitfenstern [2] kein starkes Dominanzkriterium für Knoten-Label fin- 
den lässt. Dort kann durch die möglichen Wartezeiten ein Label eine größere 
Spanne von Labein dominieren. Beim hier betrachteten Problem ohne War- 
temöglichkeit funktioniert dies nicht. Darüber hinaus wird durch die Men- 
ge der in den Knoten-Labeln gespeicherten Informationen (neben Ankunfts- 
zeit, aktueller Beladung z.B. auch die Zusammensetzung der Fahrgemein- 
schaft) die Definition einer wirksamen Dominanz erschwert. Derzeit wird 
neben diesem Multi-Label-Shortest-Path- Algorithmus ein weiterer Pricing- 
Algorithmus entwickelt, der als Br anch& Cut- Algorithmus konzipiert ist. Hier 
werden die an Netzwerkflussprobleme angelehnten Nebenbedingungen so- 
wie einige Klassen von problemspezifischen Nebenbedingungen statisch er- 
zeugt. Alle Kurzzyklus-Elimininations-, sowie zeit- und kapazitätsabhängigen 
Nebenbedingungen werden durch Schnittebenenverfahren sukzessive hinzu- 
gefügt. Dabei werden Zeit und Kapazität nicht als Variable für jeden Kno- 
ten modelliert; die diese Variablen betreffenden Nebenbedingungen werden 
statt dessen über ungültige Pfade (siehe Ascheuer in [1]) realisiert. Pfade, 
die zeit- oder kapazitätsabhängige Nebenbedingungen verletzen, werden über 
entsprechende Schnittebenen verboten. Derzeit ist der Branch&Cut- Ansatz 
allerdings noch nicht leistungsfähig genug, um mit dem Multi-Label-Shortest- 
Path- Algorithmus konkurrieren zu können. 

4 Ergebnisse 

Die Leistungsfähigkeit der bisher entwickelten Algorithmen ist in Tabelle 1 
dargestellt. Aufgrund der vielen Detaileigenschaften, die das Fahrgemein- 
schaftsvermittlungsproblem aufweist, sind umfassende Leist ungscharakteri- 




155 



sierungen recht aufwendig. Die hier vorgestellten Ergebnisse sollen zeigen, 
dass typische Anwendungsszenarien, wie sie im Betrieb an der Universität Ol- 
denburg Vorkommen können, von den Algorithmen beherrscht werden. Dazu 
dienen vier künstlich erzeugte Szenarien. Die in ihnen enthaltenen Anfragen - 
also Gesuche und Angebote - sind zeitlich kompatibel, da sie innerhalb eines 
kurzen Tageszeitraums stattfinden, können aber über mehrere Tage gestreut 
sein. In realen Daten dürften durch unterschiedliche Vorlesungszeiten größe- 
re Streuungen auftreten. Die Szenarien sind daher „Härtefälle“. Szenario 1 
entspricht der erwarteten punktuellen Maximalbelastung. In den Szenarien 
2.1 bis 2.3 wird die Entwicklung gezeigt, wenn das System ein wachsende An- 
zahlen von Anfragen bearbeiten muss, die Anzahl zeitlich kompatibler Anfra- 
gen pro Tag aber konstant bleibt. Es zeigt sich das der exakte Algorithmus 



Tabellel. Leistung der Vermittlungsalgorithmen. Mit * markierter Eintrag ist 
Abschätzung von unten, mit + markierter Eintrag Lösung <101% des Optimums. 
System: Linux, i586 Prozessor mit 733 MHz Taktfrequenz. GH— Greedy- Heuristik, 
GH+NO=GH mit Nachoptimierung, TS=Tabu-Suche, OPT=exaktes Verfahren 



Verfahren 


Szenario 

Nr. Anfragen Tage 


Qualität 

Kumulierte Unvermittelte 
Wegstrecke Teilnehmer 


Laufzeit [s] 


GH 


1 


613 


1 


22708 


55 


1204 


GH+NO 














TS 








24119 


50 


2145 


OPT 














GH 


2.1 


240 


4 


7833 


16 


28 


GH+NO 








6817 


16 


340 


TS 








6864 


8 


28 


OPT 








6392 


8 


676 


GH 


2.2 


466 


9 


17245 


18 


142 


GH+NO 








15841 


18 


2925 


TS 








16147 


9 


157 


OPT 








*13709 


9 




GH 


2.3 


971 


19 


36068 


31 


454 


GH+NO 








32955 


31 


23984 


TS 








33494 


20 


304 


OPT 








+ 28888 


20 





tatsächlich nicht in der Lage ist, praxisrelevante Probleme (Szenario 1) zu 
lösen. Es kann nur ein einfaches Problem (Szenario 2.1) vollständig gelöst 
werden. In anderen Szenarien (2.2 und 2.3) sind jedoch noch Abschätzungen 
möglich, die aufgrund der Informationen, die während des Lösungsprozesses 
gewonnenen wurden, getroffen werden konnten. Der Vergleich der exakten Er- 
gebnisse mit denen der Heuristiken zeigt, dass eine durchaus akzeptable Qua- 
lität vorliegt. Erkennbar ist auch, dass sich die Heuristiken gegenüber auf der 
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Zeitachse wachsenden Problemgrößen gutmütig verhalten. Diese Dimension 
ist besonders wichtig, da sie vor Start des Praxisbetriebs schlecht abschätzbar 
ist. Andere Dimension, wie die Verteilung der Studierenden oder die maxima- 
le Häufung von zeitlich passenden Anfragen, lassen sich eher ermitteln. Bei 
der exakten Lösung von Szenario 2.1 fällt als Randergebnis folgende Beobach- 
tung auf: Es werden 655 der insgesamt 1400 möglichen Fahrgemeinschaften 
durch das Pricing geliefert und im Master- Problem verwendet. Erfreulich ist, 
dass die Tabu- Suche immer optimal viele Gesuche vermitteln kann. 



5 Ausblick 

Es konnte gezeigt werden, dass die für das Fahrgemeinschaftsvermittlungs- 
system der Universität Oldenburg entwickelten Algorithmen die Problem- 
größen, die erwartet werden, verarbeiten können und dabei eine zufrieden- 
stellende Qualität erreichen, die durch weitere Verbesserungen noch erhöht 
werden soll. Diese anhand künstlich generierter Szenarien ermittelten Erfah- 
rungen können in der nächsten Zeit mit realen Daten überprüft werden. 
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Abstract. A single machine due date assignment and scheduling problem of 
minimizing holding costs with no tardy jobs is considered under series-parallel 
and somewhat wider class of precedence constraints. 



1 . Introduction 

For a single machine due date assignment and scheduling problem under 
consideration, due dates are determined by increasing the processing times of jobs 
by a common positive slack. The objective is to explore the trade-off between the 
size of the slack and the arising holding costs for the early jobs, and to find an 
optimal schedule that minimizes holding costs provided that there are no tardy 
jobs and precedence constraints are respected. The factors that may affect the 
complexity of scheduling problem include the structure of precedence constraints 
and the objective function involved. We consider the case when holding costs are 
represented by total weighted earliness or total weighted exponential earliness 
functions, and precedence constraints are defined by a class of graphs that is 
studied in [1, 9, 10, 12, 13, 15] and includes series-parallel graphs [2, 17]. 

Let the jobs of set N = {1,K ,n} have to be processed with no preemption on 

a single machine, and the processing of job jEiV take pj time units. The jobs 

are simultaneously available at time zero, and for each job j a weight Wj is 

given that indicates its relative importance. The machine can handle only one job 
at a time, and is permanently available from time zero. The machine is allowed to 
be idle if required. Each job j has the due date d j by which it is desirable to 

complete its processing. Let Cj be the completion time of job j in a certain 
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schedule. Job j is tardy if c j>dj, and job is early if Cj < d j with 

Ej = dj - C j being its earliness. A schedule is feasible if there are no tardy jobs 

and the job sequence respects given precedence constraints. We assume that the 
due dates are determined according to the so-called SLK rule [3], i. e., for each job 
the due date is obtained by adding a positive slack q to the processing time: 

dj — Pj +q for all j e N . We look for the value of q which minimizes the 
objective function <p(F,q) over the set of feasible schedules. Here 
F = ,E n ) is an earliness penalty function and (p{F,q) is an 

arbitrary non-decreasing function in both arguments. Extending standard 
scheduling notation [8], we refer to our problem as 

l^prec, Cj <dj = pj + q\(p(F,q) , where “ prec ” indicates the presence of 
arbitrary precedence constraints. In this paper we focus on the functions 
F = ^ n j = iWjE j (total weighted earliness) and F = ex p0^/) * where 

0 (total weighted exponential earliness). Once q is chosen or fixed, the 
corresponding scheduling problem l|/?rec, Cj < dj = Pj + q\F without due 

date assignment is to find a feasible schedule with the minimum value of function 
F . A general scheme for the due date assignment problems with arbitrary 
precedence constraints and arbitrary functions is presented in [6], and it is shown 

how to implement this scheme to obtain 0(n log n ) - time algorithms for series- 

parallel precedence constraints provided that F is either the sum of linear 
functions or the sum of exponential functions. 

In this paper, we show that our due date assignment and scheduling problem 
has a polynomial-time solution if the precedence constraints are represented by a 
more general class of graphs than series-parallel, namely, by the graphs which can 
be decomposed in such a way that the size (or width) of the “building blocks” or 
outer factors is limited. 

The functions and ex P j) are closely related to the 

class of priority-generating functions which was first introduced in [4]. Systematic 
exposition of well-solved scheduling problems with priority-generating objective 
functions can be found in [16]. The priority-generating functions admit of the 
string interchange relation [8] and are studied also by Monma and Sidney [11] 
based on decomposition approach of Sidney [14]. Polynomial-time scheduling 
algorithms for this kind of objective functions and series-parallel precedence 
constraints are considered in [5, 7, 11]. In [10, 12, 15] some of these results have 
been generalized to a wider class of precedence constraints using an approach to 
modular decomposition of sequencing problems [1, 9, 13]. 
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2. Precedence Constraints, Graphs and Posets 

Formally, precedence constraints among the jobs are defined by a binary relation 
We write i -» j and say that job i precedes j if in any feasible schedule job 

i must be completed before j starts. Binary relation -> is a strong order relation, 
that is both asymmetric ( i — » j implies that not j — > i ) and transitive ( i — » j 
and j —> k implies i — » k ). We write i ~ j if jobs are independent , i.e. neither 
i — > j nor j —>i . Precedence constraints are usually given by a directed circuit- 

free graph G in which the set of vertices is identical with the set of jobs and there 
is a path from vertex i to vertex j if and only if job i precedes job j . Recall 
that a graph is circuit-free (or acyclic) if it contains no cycles, i.e., contains no 
paths with the same initial and terminal vertices. Moreover, any directed acyclic 
graph (dag) induces a partial order on its vertices: i -» j if and only if there is a 

path from vertex i to vertex j in G . The elements of a partially ordered set 
( poset ) P = (N,R) are given by the job set N , and ordering relations R are 
defined by (i, j} e R if and only if i — > j . So, in our case, the notions of 
“precedence constraints”, “dag” and “poset” are interchangeable. For a dag, let 
(/, j) denote an arc that goes from vertex i to vertex j . The transitive closure of 

a dag G is a dag G T such that G T contains an arc (/, j) if and only if i ^ j 
and there is a path from i to j in G . 

Given a poset P = (N,R) , a subset N' cJV is a (job) module of P if for 
every job k e N\N f one of the following holds: (a) k—>i for all is N f , or (b) 
i—>k for all ie N\ or (c) / ~ k for all is N f . Let G = (N,U) be a dag 
corresponding to poset P = (N 9 R). Replacing all arcs of the transitive closure 

G t by undirected edges, we obtain the (undirected) graph G — (/V, E) . We may 
assume that G = (N,E) is given to us in the form of the adjacency matrix. A 
module A' is a set of vertices that is indistinguishable in graph G by the vertices 
outside N r ; that is, in graph G any vertex in N\N' is either adjacent to all 
vertices of N r , or is adjacent to no vertex in N f . There are three distinct types of 
modules: parallel, series, and neighborhood. To introduce these types of modules, 
we first introduce the notions of a complement graph and a complement- 

connected graph. The complement graph of G = (N,E) is the graph (N,E ') 9 
where (w,v) e E 1 if and only if (u, v) £ E . A graph is complement- connected if 
its complement graph is connected. Parallel modules are characterized by the 
property that the subgraph induced by the vertices of the module is not connected. 
A module is a series module if the subgraph induced by the vertices of the module 
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is not complement-connected. In a neighborhood module, the subgraph induced 
by the vertices of the module is both connected and complement-connected. 

For a poset P = (N,R ) , a subset SczN is initial if for each ieS all 
predecessors of i are also in S. For an initial set S, define the set 
I(S) = {j: j eS , j has no successors in S}. The maximum size of any set 
I(S ) is called the width of P . If the poset is decomposed into modules, the size 
of any module does not exceed the width of the original poset. Provided that the 
objective function possesses certain properties, it can be minimized over a poset of 
a fixed width in polynomial time. 



3. Scheduling by Modular Decomposition 

When graph is divided into modules, the decomposition process is called modular 
decomposition [13]. At any stage of the process, the current subgraph being 
decomposed will be a module of the original graph. Each of these subgraphs is 
decomposed recursively. This process continues until all the subgraphs being 
decomposed contain only a single vertex. The decomposition procedure 
decomposes the graph uniquely. Parallel modules are decomposed into their 
connected components. Series modules are decomposed into their complement- 
connected components. Neighborhood modules are decomposed into maximal 
submodules, where a module M f is a maximal submodule of a neighborhood 
module M if M' is contained in M , and no proper submodule of M contains 
M ' . Every vertex of M is contained in a unique maximal submodule. 

To describe modular decomposition formally we shall use the following 
notation of Sidney and Steiner [15]. Let P 0 = (Af 0 ,/? 0 ) a P oset °f m elements 

with N 0 = {/i,i 2 ,K J m } and let P h =(N h ,R h ) for Ä = l,2,K,ra be disjoint 
posets. The composition poset P = ( N , R ) is defined by N = N h and 

R = YZ =l R h Y{(ij):ieN h ,jeN k and {i h J^eRq} . For this composition, a 
notation P = P 0 [Pi,K ,P m \ is used, where P 0 is referred as outer factor and 
as the inner factors. Then P is the series composition S of the inner 
factors when /q is a chain, and the parallel composition P when i h ~ i k for all 
i h ,i k e Nq . In any other case, P is called a neighborhood composition N. Here, 

each inner factor is a module of P . Buer and Möhring [1] and Muller and Spinrad 
[13] propose algorithms for canonical decomposition of a poset into modules. For 
a poset P = (N,R) these algorithms construct the composition tree T(P) by 
identifying one of the following three possibilities: 

(P) P = P 0 [P 1 ,K,P m ] (m > 1 ) is a parallel composition. 
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(S) P = Pq [Pi ,K , P m ] ( m > 1 ) is a series composition. 

(N) The maximal modules different from N partition N into Y)” =1 N h 
(m> 4) with P = /o[Pi,K,P m ] being a neighborhood composition, where 
n>K,P m are the subsets of P induced by ,K , N m respectively, and P 0 is 
the outer factor obtained from P by contracting each P h into a new element i h , 
h = 1,K ,m . 

By identifying for the original poset P which of these cases applies and by 
repeating this operation for each inner factor found, the modular decomposition 
procedure is implemented as iterative process until all factors have been 
decomposed into single elements. The composition tree T(P) is a data structure 
to represent this process: the root of T(P) is labeled by the set N and is 
assigned a type indicator S, P, or N, depending on which of the three cases applies 
to P . The sons of N correspond to the inner factors P h of P and are labeled by 
the corresponding set N h and type indicators S, P, or N, depending on which case 
applies to P h . The leaves of T(P) correspond to single elements of P . For 
details on decomposition process and constructing T ( P ) see [1, 13, 15]. Note that 

algorithm [13] requires 0(n ) time for the decomposition of a poset into 
modules. 

When the objective functions of scheduling problems satisfy job module 
property which states that any optimal solution to a problem defined by a job 
module is consistent with at least one optimal solution for the entire problem, 
efficient algorithms can be used to solve the scheduling problems [12, 15]. These 
algorithms obtain optimal sequences by finding optimal subsequences for 
progressively larger modules and use efficient procedures [9, 13] for locating 
modules in a precedence network. Let us give formal definition for job module 
property and DP recursion property. An objective function / possesses the job 

module property [12, 15] if it satisfies the following condition: If N f is a job 
module of poset P = (N,R) and s' is an optimal sequence for the problem on 
P r = ( N\R f ) , where P f is a subset of P induced by N r , then there exists an 
optimal permutation s for P such that s' = s\N f , where s\N' is the restriction 

of s to N f , i. e., the permutation induced by 5 on iV'. DP approach uses the 
following recursion property of the objective function f(N ) over the initial sets 
SeN: f(S) = rmn{g(f(S-j\SJ):jeI(S )}, where /(0) = 0, g is a 
recursion formula, S — j is shorthand notation for S\{j}, and 
I(S ) = {j: j eS and j has no successors in S } . 

If the recursion g can be computed in constant time for any given set of 
arguments and K denotes the number of initial subsets of poset P = (N,R) , 
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then the computation of f(N) requires O(Kw) time, where w denotes the 
maximum size of any set I(S ) and is called the width of P . The procedure to 
find an optimal permutation, after f(N ) has been calculated, requires 0(nw) 
time: the optimal sequence is generated in the reverse direction, starting from 
S = N and identifying a job j e S for which the minimum was obtained in the 
recursion property; this j is placed last among the jobs in S , and S is replaced 

by S — j until we obtain S - j = 0 . Since K < 0(n w ) [15], the DP algorithm 

for a fixed positive w requires at most 0(n w ) time to find an optimal sequence 
if P G C w , where C w denotes the class of posets with width less than or equal to 

w. 

Sidney and Steiner [15] propose a combination of decomposition algorithm [9, 
10] and DP to find optimal solutions for the problems that have both the recursion 
and the job module properties. They define the class D w of posets such that for 
any positive w > 1 the poset P belongs to D w if and only if P can be built by a 
finite number of successive compositions of posets in which every outer factor is 
in C w , i.e., every outer factor has a width < w . Then, D w also contains C w , 
and D 2 contains series-parallel posets. The combination of dynamic 
programming (DP) with modular decomposition proposed in [15] enables to 
enlarge the polynomially solvable classes of sequencing problems. 

Coming back to our due date assignment and scheduling problem, we can 
denote it as l| D w ,w> 2; Cj < dj = pj + q\p(F,q) in case when precedence 

constraints belong to the class D w of posets with w > 2 . If F is either linear 
F lin — ^ w j Cj or exponential F EXP = w j QXp(—yCj ) functions, then the 

problem under consideration posses the DP recursion property and the job module 
property. DP recursion property for the functions F LIN and F EXP holds since the 
recursion formulas for F LIN and F EXP , respectively, can be written in the 
following way: g(F LIN (S - = F UN (S - j) + Wj^Pi and 

ieS 

g( F EXP (S - j)’ S > j) = f exp ( s - J) + W J exp(-7 X ft) • To show that 

ieS 

functions f ijn and F EXP posses the job module property, we can use the result 
by Monma and Sidney [12] who have shown that the following three conditions 
are sufficient for the job module property to hold: 

1. Strong adjacent sequence interchange property which is equivalent for the 
function to be priority-generating and therefore holds for F LIN and F EXP . 
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2. Strong series network decomposition ( strong SND) property which is valid 
for objective function F if the following condition holds for all permutations 
s and t of the same set: for all sequences u and v , F(s) < F(t) if and 
only if F(u,s,v)<F(u,t,v ) . 

3. Consistency property which is valid for objective function F if there exists a 
relation n defined on all pairs of sequences satisfying the following 
property: for all permutations s and t of the same set, if F(s) < F(t) then 
snt . 

The verification that strong SND and consistency properties hold for f un and 
F E xp follows directly from [11, 12]. As a result, problem 

l\D w , w > 2; Cj < dj - Pj + q\q?(F,q) is solvable in polynomial time for the 

fixed w by algorithms proposed in [6] and, in particular, in time if 

each N-type outer factor of precedence constraints has cardinality < m for a fixed 
constant m . 
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Abstract. When solving crew scheduling problems by column generation, the main 
task is to solve the pricing problem for introducing new columns. This problem is 
ATP-hard and usually requires more than 90% of the overall computation time in all 
of our experiments as well as in experiments reported in the literature. Therefore 
it is critical to achieve good performance in this step. This paper discusses an 
approach of using a cluster of computers to solve the pricing problem. Several 
aspects of parallelizing the pricing step are investigated and computational results 
are reported. The parallel algorithms are designed in such a way that they facilitate 
extensions and generalizations. 



1 Introduction 

The planning of airline operations usually consists of four phases. First, a 
timetable is constructed to satisfy the expected passenger transportation re- 
quests. Then aircrafts are allocated to flight legs. The third step is the crew 
scheduling problem, the problem we are dealing with in this paper. It con- 
sists of generating rotations (pairings) of crews in order to cover all flight 
legs. For the assignment of crews to flights a set of complicated airline rules 
and regulations according to laws have to be observed. Note that in this step, 
individuals are not yet considered. The final step called the rostering problem 
is the task of assigning pairings to individual crews where further aspects, 
like vacation plans or technical skills, are taken into account. 

We model the crew pairing problem as an integer linear programming 
problem, or more precisely as a set partioning problem 

min c T x 
s.t. Ax = 1 
x G {0,l} n . 

In the context of the crew scheduling problem, a column of the matrix 
A corresponds to a feasible pairing and a row to a flight that has to be 
serviced. We have A , ^ = 1 if pairing j covers flight z, and Aij = 0, ptherwise. 
The cost of pairing j is given by Cj. The variable Xj states whether the 
respective pairing is in the solution or not. The cost Cj of a pairing includes 
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the crew costs, the accommodation costs and the penalty costs. The particular 
property of this approach is that we have a problem with a huge number of 
variables, since virtually every possible pairing should be taken into account. 

We solve the problem with a branch-and-cut algorithm based on the 
canonical linear programming relaxation where the condition x e {0,1 } n 
is replaced by 0 < x < 1 . The appropriate way to solve such linear programs 
is to employ column generation where one starts with a subset of possible 
pairings and adds further ones as needed. The central step of column gener- 
ation is therefore similar to the pricing of nonbasic variables in the revised 
simplex method. 

At each major iteration k of the column generation method, we have the 
current matrix the objective vector c fc , the variable vector and the 
dual vector u k . After solving the so-called restricted master problem , 

• k 

mm c K x K 
s.t. A k x k = 1 
0 < x k < 1 , 

the solution ( x k , u k ) will be used as input to the pricing step. The pricing 
problem amounts to solving the optimization problem 

. uT A 

mm Cj — u K A'j 

jej 

where J is the set of all possible variables in the master problem. The 
purpose of the pricing step is to find negative reduced cost columns if they 
exist or to prove that there are no such columns. 

The computation time for solving the pricing problem dominates the total 
time. In the context of the crew pairing problem, it is an AfP-hard problem 
and the time spent for solving the pricing problem usually amounts to about 
90% of the total computation time. In this paper we cannot cover all aspects 
of the crew scheduling problem. Instead we only focus on how to solve the 
pricing subproblem effectively. 

Many algorithms have been suggested to solve the pricing problem to opti- 
mality. Desrosiers et al. [4] discuss many aspects of using resource constrained 
shortest path algorithms. Another way is to use /.-shortest path algorithms 
to find the most negative reduced cost variables. After ranking paths be- 
tween two given nodes by fc-shortest paths algorithms, a rule and regulation 
checking procedure will eliminate infeasible pairings. An application of a k- 
shortest path algorithm [6] is developed by the CARMEN system to solve 
the crew scheduling problem. Constraint Programming comes into play with 
the ability to model these rules quickly and easily. General approaches are 
discussed in [5] and there are many papers concerning the use of constraint 
programming in crew management operations. 

There has already been effort to use parallel computers for solving crew 
scheduling problem. In PAROS [2], the parallelization is not implemented in 
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the process of solving the linear relaxation problem of the master problem. 
Instead, PAROS distributes the enumeration of pairings over the processors 
and their outputs will be fed into a set covering optimizer which is an iterative 
Lagrangean heuristic. The set covering optimizer was also parallelized, but 
not as successful as the enumeration phase. The parallel algorithm showed 
good performance when solving some real-world problems of Lufthansa. An- 
other system employing parallel computing is RALPH of Marsten [1997], 
but, unfortunately, there is no published report available. A further idea for 
using parallel computers was suggested in [7]. Here the huge number of fea- 
sible pairings is generated in parallel and then used to construct constraint 
matrices of set partitioning problems. These problems are then solved by 
branch-and-cut approaches. 

In this paper we want to apply parallelization for solving the pricing 
problem faster. In Section 2, we discuss several sequential pricing algorithms 
in order to determine the ones suitable to be parallelized. A master-slave 
model and implementation aspects for obtaining good performance are main 
points of Section 3. The advantages and disadvantages of constraint logic 
programming for our research are discussed in Section 4. Section 5 gives 
some conclusions. 



2 Sequential Algorithms 

Methods for solving the pricing problem can be classified into the categories 

• resource constrained shortest path algorithms, 

• /^-shortest paths algorithms, 

• exhaustive and heuristic enumeration, 

• constraint logic programming. 

The two first methods are based on graph algorithms. Although much 
work has been done in the area of parallel shortest paths, the theoretical 
worst case execution times of these parallel algorithms have the same bounds 
as those of the sequential ones [3] . These algorithms only work well on sparse 
or regular graphs which are efficiently partitioned into subgraphs having few 
boundary nodes. Unfortunately, this is not the case for the flight graphs of 
crew pairing problems. Moreover, there has been little effort for parallelizing 
resource constrained shortest paths and fc-shortest paths algorithms on dis- 
tributed memory machines. Most of them are concerned with shared memory 
systems. For example, in [8] an algorithm was suggested for the theoretical 
concurrent-read exclusive-write PRAM model. This is mainly due to the fact 
that these algorithms have a strong data dependency among computing nodes 
which is only inefficiently implemented on distributed memory parallel com- 
puters. Another disadvantage of these methods is that they are not well suited 
for extensions. Since airlines rules must be embedded into graphs, including 
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a new rule requires the reconsideration of the graph structure and algorithms 
as well. This difficulty also occurs in sequential algorithms. 

Surprisingly, enumeration turned out to be a good choice for paralleliza- 
tion although it is the worst solution to many combinatorial optimization 
problems. The general implementation is usually easy because the rule check- 
ing can be treated separately as a black box. Moreover, we can apply applica- 
tion-specific heuristics to speed up the search process. A master-slave model 
can be used to implement an implicit exact search method. There is a job 
dispatcher to deliver dual values and lower bounds to enumeration blocks 
and receive pairings from them. 



3 Parallel Pricing 

Enumeration is parallelized in a straightforward way. The single jobs are 
independent, whether we use implicit (like constraint programming) or ex- 
plicit (like exhaustive enumerating) approaches. They can be shared among 
processors of a cluster without any data dependency. The most effective par- 
allel model for our problem is the master-slave model. In addition to the 
divide-and-conquer framework, we also use a bounding technique which is 
very helpful to reduce the search region. 

For easy scalability, in our master-slave model, we dedicate processor 0 
to be only responsible for distributing jobs, waiting for results and running 
the branch-and-cut kernel based on the framework ABACUS [9]. Note that 
the job of a slave in this approach consists of finding negative reduced cost 
pairings starting from a given flight. Due to the centralized control, we can 
easily apply a bounding technique. Remember that the initial lower bound is 
zero because we only find negative reduced cost pairings. We also use some 
application-specific heuristics to improve the performance of the algorithm. 

Another point to be addressed is from which flight leg the enumeration 
will start in the next iteration of the column generation. If we always start 
from the same flight leg (e.g., the first flight of the schedule) in every iter- 
ation, we possibly only generate new pairings which are similar in structure 
to the pairings already contained in the current restricted master problem. 
Therefore they will only slightly improve our integer programming model. In 
order to make the search more effective, we change the starting flight leg in 
every iteration. In our implementation we start from the flight leg right after 
the one where the previous iteration stopped. 

Since the computation time of each job is nondeter minist ic, we can ex- 
perience an unfortunate behavior of the slaves. Namely, it can happen that, 
although the termination condition has been reached (e.g., enough new pair- 
ings have been generated or there is no more flight leg to send to slaves), 
the master still must wait for the completion of all slaves. If a slave has 
been assigned a difficult task, then the master also must suspend its further 
activities. 




169 



1: timer . start () ; 

2: while ( !( terminate condition reached ) ){ 

3: forall p idle { 

4: if ( ! ( terminate condition reached ) ){ 

5: send( p, SeqNo ); 

6: send( p, job ); 

7: > 

8: > 

8: if (( some slave idle )&&( #pairings found > 0 )){ 

9: FreeTime = timer . stop () ; 

10: if ( FreeTime / BusyTime >= IDLERATIO ) 

11: break; 

12: else 

13: timer. start ( without reset ); 

14: > 

15: if ( incomming result from p ){ 

16: recv( p, Slave_SeqNo ); 

17: if ( SeqNo != Slave.SeqNo ) 

18: continue; 

19: recv( p, result ); 

20: if ( terminate condition reached ){ 

21: BusyTime = timer. stop ( with reset ); 

22: timer. start ( reset ); 

23: > 

24: > 

25: > 

26 : SeqNo ++ ; 



Fig. 1. Number sequencing technique 



We employ a numbering technique, outlined in Figure 1, to reduce the idle 
times of slaves between the solution of the current linear programming relax- 
ation and the pricing step. Each computing job sent to slaves is accompanied 
by a sequence number. This number is compared with the number received 
from slaves (lines 17, 18). If they match, the received result is valid for the 
current iteration, otherwise, we discard the result. The code segment of lines 
8-14 has the consequence, that if FreeTime (i.e., the duration between the 
time when the termination condition was reached and the current time) is 
large, then the algorithm will stop waiting and go immediately to the linear 
programming relaxation. The length of that period is controlled by the ratio 
IDLERATIO. This ratio should be kept small (e.g., 0.1%). 

For our computational experiments, we generated several crew pairing 
problem instances at random, however taking the structure and regulations of 
real problems of Vietnam Airlines into account. The original instances turned 
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out to be too small and therefore too easy. All instances are guaranteed to 
have feasible solutions, each flight set has about 510 flight legs. The instances 
are very difficult for all sequential algorithms. 




Fig. 2. The speedup of the master-slave approach 



With the features we have discussed so far we obtain a good reduction 
of the computation time. In Figure 2, speedups are almost linear on our test 
instances (FS1-4), especially for a number of processors less than about 16. 
This is also due to the fact that our parallel approach distributes flight legs to 
slaves in the same order as in the sequential program. Therefore the search 
path remains more or less the same in the parallel run. The phenomenon 
that using many processors could give a bad performance in the figure is 
only due to the difficulty level of our test instances. We should only use more 
processors to solve more difficult instances. One of the interesting remaining 
questions is how to represent airlines rules and deal with them efficiently and 
quickly. 



4 Parallel Pricing and Constraint Logic Programming 

Clearly, it is more comfortable to use the declarative programming model of 
constraint programming to represent airlines rules. Our implementation uses 
ECI/PS e [l]. Let Tb be a flight set that is to be scheduled in an intended 
schedule period. Because the schedule is the same for next periods and the 
duration of a pairing is limited within the maximum number of days MaxDays 
we repeat Tb several next periods in order that all possible pairings will be 
covered, obtaining a new flight set T. This set will be used as a base domain 
for flight variables. If P is a pairing variable, it must be a list of flight variables 
whose domains are T . Note that the first flight variable only has a domain 
of Tb because the first flight must be within the schedule period. With these 
notations, we can easily present all airlines rules. In order to improve the 
performance of the algorithm, we also include a constraint to exclude pairings 
in advance which cannot have negative reduced costs. The idea behind this 
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is to reduce the domain of a flight variable of a pairing variable with the help 
of dual values and the minimum resting period between flights. 




Fig. 3. The computation time of two pricings, one uses C++ rule checking and the 
other one constraint logic programming rule checking 



Search on the finite domains of variables is a good target for paralleliza- 
tion. Domains could be decomposed independently into several sub-domains 
depending on computing resources. We again apply the master-slave model 
and the techniques mentioned in Section 3. For ECI/PS 6 , the first flight vari- 
able of a pairing variable now has a domain of one flight leg which is assigned 
by the master. All rules described by ECL* PS e remain unchanged. Therefore, 
it is easy to include more airline regulations. However, the computation times 
are quite bad mainly due to the slow search performed by ECI/PS 6 . Using 
up to 22 processors, we could only obtain a computation time of about 1 hour 
for the same problems which have been solved by the previous method. In 
view of this we decided to use constraint logic programming only for checking 
the validity of pairings. In this way, the implement ion not only exploits the 
property of representing rules easily, but also inherits the efficiency of the 
branch-and-bound framework. 




Fig. 4. Speedups to solve test instances with using constraint logic programming 
for rule checking 
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The computation time is now more reasonable. In Figure 3, the problem 
FS1 is solved within 2 hours. However, also in this figure, we see that the 
rule checking by constraint logic programming cannot have a performance as 
good as the C++ rule checking. As mentioned above, by reusing all features 
of the C++ implementation we also obtain good speedups in solving our test 
instances, depicted in Figure 4. 

5 Concluding Remarks 

Crew pairing problems are very hard and the computing time is mainly spent 
in the pricing part. Reducing the time for pricing significantly improves the 
branch- and-price approach for solving practical problems. In a fairly general 
framework, we have addressd some aspects of parallelizing sequential pricing 
algorithms and selected the best algorithmic approach to the crew pairing 
problem. Our parallel pricing algorithms can also handle further extensions, 
e.g., quickly changing rules and regulations of airlines by using constraint 
logic programming. The computation time for the pricing step decreases dra- 
matically proportional to the number of processors in use. It will be helpful 
to apply our approach to solve the crew pairing problem with the branch- 
and-price framework. 
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Abstract. We consider a workforce scheduling problem that arises when schedul- 
ing the employees of a casino for a prescribed time period. Given a set of tasks for 
each day, we are looking for a sequence of tasks and days off for each employee. All 
sequences have to observe (hard) legal and contractual constraints as well as (soft) 
in-house restrictions. The overall objective is to minimize violations of the soft 
restrictions and evenly distribute attractive tasks among employees. Apart from 
regular employees, we have to take into account temporary employees, where each 
employee is characterized by a certain set of skills. 

First, we consider an exact solution procedure based on a minimum-cost multi- 
commodity network flow formulation, which can be solved by means of column gen- 
eration and branch-and-bound techniques. For large problem instances we propose 
a local search algorithm. An initial solution is obtained by successively solving sev- 
eral assignment problems. Two Hill Climbing procedures are used to improve the 
initial solution. 



1 Introduction 

Service industries are usually characterized by high personnel expenses as 
well as varying demands. Varying demands together with the fact that ser- 
vices cannot be stored lead to a changing labor utilization over time. Since 
employees cannot be hired or laid off easily in the short-term, peaks in the 
labor utilization have to be absorbed by temporary personnel or flexible work 
schedules. 

In this paper, we consider a workforce scheduling problem arising in casi- 
nos. Increasing absence of customers throughout the past years forces casino 
carriers to pursue a policy of cost-cutting. Scheduling a workforce efficiently 
is an important possibility to cut down on personnel costs. Generating work 
schedules manually often requires the working time of one entire employee, 
while the application of automated scheduling systems dramatically decreases 
the required computation time and at the same time increases the quality of 
the generated schedules. 

Based on a forecast of the number of expected customers, we assume that 
the kind and number of games to be offered is given. Every game belongs 
to an early (E), mid-day (M), late (L), or long late shift (LL) and can be 
subdivided into tasks (cf. Figure 1), each of which requires certain skills. 
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Casino Operations 




Fig. 1. Casino games and corresponding tasks 



Each employee belongs to one of several wage scales. Associated with a certain 
wage scale is a set of skills that are required for a task. Figure 2 shows two 
screenshots from our implementation, namely the scheduling of games (cf. 
Figure 2(a)) and the definition of skills for an individual employee (cf. Figure 
2(b)). The aim of workforce scheduling is to find a sequence of tasks and 
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Fig. 2. Screenshots 

days off (DO) for each employee. A sequence is feasible if the corresponding 
employee possesses the skills required for all tasks in the sequence and if it 
complies with additional restrictions given by (hard) legal and contractual 
constraints due to wage agreements. Moreover, we consider (soft) in-house 
restrictions, which serve to improve the working morale. Our objective is to 
minimize violations of soft restrictions and to evenly distribute attractive 
tasks among employees. 

In Section 2 we specify the hard and soft restrictions as well as the objec- 
tives in detail. In Section 3.1 we present a minimum-cost multi-commodity 
network flow formulation for the problem under consideration. An exact solu- 
tion can be obtained by means of a branch-and-price procedure. In Section 
3.2 we propose a local search procedure for large problem instances. In a 
construction phase, an initial solution is obtained by iteratively solving sev- 
eral assignment problems. The initial solution is then improved by two Hill 
Climbing procedures. We close the paper with some conclusions. 
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2 Restrictions and Objectives 

In a casino, workforce scheduling is subject to manifold restrictions. We have 
to distinguish between hard restrictions that must be obeyed and soft restric- 
tions which should be obeyed. Since there may be no feasible solution which 
satisfies all soft restrictions, violations of soft restrictions are penalized. 

1. Hard restrictions 

(a) No employee may be assigned to a task he is not qualified for. 

(b) Each employee must receive two days off for every 5 work days. 

(c) No employee may work longer than 10 days in a row. 

(d) In between two shifts, there must be at least 11 hours of idle time. 

2. Soft restrictions 

(a) Every employee should be assigned at least one day off every week. 

(b) No employee should be assigned an isolated day off. Instead, at least 
two days off in a row should be scheduled. 

(c) A day off should be preceded by another day off or an early shift and 
should be succeeded by another day off or a (long) late shift. 

(d) Every employee should work in between 3 and 7 days in a row. 

(e) A vacation should be preceded by an early and succeeded by a (long) 
late shift. 

(f) No employee should work the same task more than 4 days in a row. 

Nightwork as well as work on Sundays and holidays is awarded with extra 
pay of up to 190% of the ordinary wages. Thus, next to finding a feasible 
solution which minimizes violations of restrictions 2(a) - 2(f), we have to 
evenly distribute these boni, i.e., the corresponding attractive tasks, among 
all employees throughout the year. 

3 Solution Methods 

Often, workforce scheduling problems are formulated as set partitioning or set 
covering problems (cf. eg. [3]). However, the exponentially increasing number 
of decision variables makes even the linear relaxation of such problems hard 
to solve. Thus, we either need to (a) determine a way to efficiently handle 
large numbers of variables or (b) employ heuristics. In order to solve problems 
with a large number of variables, branch-and-price algorithms have been well 
proven in literature, for instance in the case of workforce scheduling prob- 
lems arising in the airline industry (cf. e.g. [1] and [4]), retailing industry (cf. 
e.g. [7]), or health services (cf. e.g. [8]). Moreover, there are several heuristic 
approaches to be found, for instance Tabu Search (cf. e.g. [5]) or Simulated 
Annealing algorithms (cf. e.g. [2]). Approaches for problems subject to prece- 
dence constraints between tasks can be found in [9]. 

We outline an exact branch-and-price procedure for a simplified version 
of our workforce scheduling problem. Furthermore, we propose a local search 
procedure which is able to solve large problem instances with respect to all 
our restrictions and objectives. 
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3,1 Branch— and— Price 



We consider a planning horizon of h = 1, . . . , 14 days. Sh denotes the set of 
all tasks on day h. With each task i G S := U^=i &h we associate a pair 
(si,ei) representing the events “start” and “end” of task i. The set of pairs 
( Si , ei) for all % G 5 is denoted by S'. So called transitions are used to model 
changeovers from one task to another. A transition between two tasks i G Sh 
and j G Sh', h < h', is modelled as a pair {ei,Sj). T denotes the set of all 
transitions. 

In what follows, we consider a network G := (N, A). The set of nodes N 
consists of all Si and e* ( i G S ) as well as a source r and a sink s. T' consists 
of the pairs (r, Si) for all Si G AT, (a, s) for all G N, i G S, and (r, s). For 
each pair (i, j) G S' U T U T' graph G contains a directed arc (i,j) between 
nodes j. Thus, the set of arcs A can be represented by S' U T U T'. 

For each wage scale #G{l,...,<2}we have a set of employees K q . Each 
task ( i,j ) G S' has to be assigned to an employee k G K q in between a min- 
imum and maximum required wage scale q.^ q ^ G {1, . . . , <2}, respectively. 
With each arc (i, j) G TUT' we associate a weight Cij and w.l.o.g. we assume 
that this weight is equal for all employees k G K q , q G {1,...,Q}. Weights 
Cij are used to penalize violations of restrictions 1(d), 2(c), and 2(e) (cf. Sec- 
tion 2). With P q we denote the set of all feasible paths from r to s in G for an 
employee k G K q . Such a path can be interpreted as a sequence of tasks and 
days off. Path p G P q is feasible if q^ < Q < q tj for all arcs (i, j) G S' on path 
p. Moreover, we introduce a binary variable Sfj which equals 1 if (i, j) G A 
is part of path p G P 9 , 6^ = 0 otherwise. c(p) denotes the length of path 
p G P 9 , i.e., c{p) = Yl(i,j)eA Finally, we require a set of decision vari- 

ables (fp which equal 1 if employee k G K q is assigned path p € P q , = 0 
otherwise. A minimum-cost multi-commodity network flow formulation for 
our workforce scheduling problem with the objective of minimizing violations 
of restrictions 1(d), 2(c), and 2(e) and subject to restrictions 1(a), 1(b), and 
1(c) (cf. Section 2) now reads 



Min - EE E c{p)Vp 

q= 1 peP q k£K q 
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One commonly used possibility to solve the latter problem is the application 
of a branch-and-price procedure. In this context, the efficient solution of the 
linear relaxation of the underlying problem is of particular importance and 
can be achieved by means of a column generation approach. Since the linear 
relaxation $ of problem (1) - (5) generally contains a very large number of 
decision variables, we initially consider a restricted version <£' of problem <£, 
called the restricted master problem. <&' contains only a small subset of the 
variables (p k . A proper subset of such variables can be derived from any basic 
feasible solution of Such a solution can in turn be obtained by generating a 
disjunctive path for each employee from r to s subject to the hard restrictions 
described in Section 2. 

Starting with an optimal solution to <£', in each step we determine some 
additional variable <p k that is appended to <£'. The problem of finding a 
variable (p k with minimum reduced objective function coefficient c(p) < 0 is 
called the sub-problem. For the problem at hand, this sub-problem is equal 
to the solution of several shortest path problems in G , one for each k G K q , 
Q 1 , . . . , Q. 

Given an optimal solution to and the values ßij , and of the 
dual variables for each restriction (2), (3), and (4), respectively, the reduced 
objective function coefficient of any variable can be computed as 

c(p) = c(p) - (a T , ß T , 7 T )a p , 

where a p is the column in the coefficient matrix corresponding to variable (p k . 
a p is of the form (l kq , 8 P , 1 kq (J2(i,j)es f $ij)) > where l kq is the YllZi \K a \ + 

k-th column of the Y^=i \K q \ x X^Li \K q \ identity matrix. Pivoting an 
additional variable (p k into the basis improves the current objective function 
value if 



£ MS+ £ 

(iJ)£A\S' (ij)es' 



( c ij ßij Ik) 

" v ' 

modified weight of arc (z,j) 



G S' 



< OL k 



( 6 ) 



holds. Thus, for each employee k G K q we determine a feasible shortest path 
from r to s with respect to the modified weight — ßij — 7^ of the arcs 
(i,j) G S f . If the resulting total length of the shortest path is less than a k , 
then the path is appended to problem i.e., we add another variable (p k as 
well as the corresponding column a p to 

The process of solving and finding and appending shortest paths is 
repeated until there is no shortest path for any employee k G K q for which 
condition (6) holds. The proposed column generation approach can be em- 
bedded into an appropriate branch-and-bound framework in order to obtain 
integral solutions. 
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3.2 Local Search 

Generating an Initial Solution An initial solution is obtained by deter- 
mining for each day an assignment between employees and tasks. Thus, we 
formulate an assignment problem for every day, which can be visualized as a 
bipartite graph (cf. Figure 3). Source nodes correspond to available employ- 
ees and sink nodes correspond to daily tasks as well as days off. The number 
of days off an employee is entitled to depends on the number of days he 
is available for work. The total number of days off is allocated to individual 
days according to a predefined strategy. Moreover, sources and sinks are fully 
interconnected by directed arcs, which represent an assignment of employees 
to tasks or days off. 



available planned available planned 

employees tasks employees tasks 




temporary employees reserve tasks 

Fig. 3. An assignment problem for a single day 

To ensure that the number of sources is equal to the number of sinks, we 
insert either further (temporary) employees or (reserve) tasks (cf. Figure 3). 

The most important step during the initialization of a daily assignment 
problem is the determination of appropriate arc weights. Our goal is to de- 
termine arc weights which lead to work sequences in accordance with the 
underlying restrictions 1(a) - 2(f). A good work sequence should resemble a 
sequence of shifts of the form (LL, . . ., L, . . ., M, . . ., E, . . ., DO, . . ., LL, 
. . .). We consider three factors when determining arc weights: 

• Qualification: Arc weights are used to penalize assignments of employees 
to tasks for which they are not sufficiently skilled. 

• Previous assignments: We consider the number of uninterrupted work 
days, the shift types of the last three assignments, and the shift type 
of the assignment under consideration. Long periods of work as well as 
illegal or unfortunate work sequences are penalized. 

• Day off assignments: We consider the number of days off an employee has 
yet to receive, the remaining number of days until the next predefined 
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day off or the end of the planning horizon, and the shift types of previous 

assignments. Supernumerous and insufficient assignments of days off as 

well as predictably unfortunate assignments are penalized. 

The assignment problem for each day can be polynomially solved by means of 
the well-known Glover-Klingman algorithm (cf. [6]). Note that the optimal 
solution of an assignment problem depends on solutions that were obtained 
for assignment problems on previous days. 

Hill Climbing Procedure The initial solution is improved by two Hill 
Climbing procedures that pursue two hierarchically ordered objectives: (a) 
improving the quality of sequences and (b) evenly distributing boni (i.e., 
attractive tasks) among employees. Neighboring solutions are obtained by 
swapping the assignments between two employees for one and the same day of 
the planning horizon. Swapping is permitted only if the resulting neighboring 
solution complies with the hard restrictions in Section 2. 

The first Hill Climbing procedure serves to improve the quality of individ- 
ual work sequences regarding their violation of the soft restrictions 2a - 2f. 
Starting with t = 14, we swap two assignments on day t — 1, if this improves 
the objective function value of the assignment problem for day t. This step 
is repeated for £ = 13, ... , 2. 

The second Hill Climbing procedure pursues the objective of evenly dis- 
tributing boni for work on weekends, public holidays, etc. among all employ- 
ees throughout the entire year. For this reason we minimize the absolute 
deviation of an employee’s ratio of regular rate hours to bonus hours from 
the mean ratio over all employees. For every day t — 1, . . . , 14, we thus swap 
two assignments in t if this decreases the aforementioned deviation. 

The chosen neighborhood operator ensures that, depending on the initial 
allocation of days off, a globally optimal solution can be reached from any 
starting solution. Moreover, it should be noted that our implementation of the 
local search algorithm contains further interesting features: (a) Employees can 
express wishes concerning single assignments, (b) if no feasible solution can be 
found, the algorithm completes its calculation and assists a human scheduler 
in developing an appropriate workaround, and (c) temporary employees are 
assigned to days and shifts for which they are actually available by means of 
a network flow problem. 

4 Conclusion 

Preliminary results show that the column generation approach (cf. Section 
3.1) is able to solve small and medium sized problem instances. A proper 
branch-and-bound framework is currently being implemented. Moreover, it 
has to be investigated whether the proposed minimum-cost multi-commodity 
network flow formulation can be expanded in order to consider further prac- 
tical restrictions. 
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The local search algorithm described in Section 3.2 has been implemented 
in the context of several diploma theses and successfully deployed with the 
“Spielbank Baden-Baden” . Concerning the fulfillment of the soft restrictions 
described in Section 2, solutions obtained by the algorithm have been at least 
as good as those obtained by an experienced human scheduler. However, while 
the working time of one entire employee was necessary to generate a work 
schedule for each employee, the local search algorithm generates a solution 
in less than two minutes. This enables users to generate several alternative 
work schedules. Reviewing the results takes about one hour and is facilitated 
by a reporting component, which points the user to unfortunate sequences. 
Moreover, a human scheduler was not able to pursue the objective of min- 
imizing the deviation of an employee’s ratio of regular rate hours to bonus 
hours from the mean ratio over all employees. The proposed local search 
procedure is able to keep this deviation within 10%. Nevertheless, we feel 
that there is still some promising research to be done regarding the proposed 
local search approach. One major topic is the development of neighborhood 
operators which additionally allow to optimize the allocation of days off to 
individual days of the planning horizon. 
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Abstract. Web usage mining relies on web server logfile data. Parts of this data 
originate from web robots. This can - with repsect to the original aims of web 
mining - lead to contradicting decisions based on distorted results. We describe 
possibilities of web robot detection and give examples how, e.g., e-metrics and 
results of association rule algorithms can differ based on raw logfiles versus those 
that consist of requests of human users or web robots. 



1 Introduction 



1993 is the year where some of the first known web robots appeared in the 
internet [24], e.g., ’’Wanderer” by Matthew Gray (measuring web growth) and 
” JumpStation” by J. Fletcher (indexing). At that time, commercial web usage 
played a minor role, instead overloaded web servers or waste of bandwith were 
areas for robot deployment problems. Nevertheless, those problems together 
with a growing number of newly used robots led to a standard for robot 
exclusion ([18]). Today, most robots adhere more or less strictly to existing 
guidelines for robots. With about 16% of the web traffic originating from 
robots ([19]), nowadays, robot detection must be considered for serious web 
mining efforts. While cooperative robots can be detected with the help of a 
simple heuristics (as we will see later) malignant robots ignore the guidelines 
mentioned above and may even apply stealth technologies. Generally, there 
is not much known about malignant robots as their usage on the net is 
somehow ’’unethical” (e.g., extraction of mail addresses for spamming ([17]), 
unauthorized usage of US Government’s Weather Service ([3])). 

There exist four major categories of widely used robot detection tech- 
nologies: Simple methods , traps , web navigation behavior analysis , and navi- 
gational pattern modeling. Simple methods check the [request], [agent], and 
[IP address] fields in Webserver logfile entries against lists of known robot 
identifications ([5]). Traps consist of links within the HTML pages that are 
invisible for a human user. If such a link is visited, it must have been visited 
by a robot ([20]). Web navigation behavior analysis searches for typical navi- 
gation characteristics based on the objectives of the different classes of robots 
([2]). Navigational pattern modeling calculates session attributes and applies 
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data mining algorithms that try to detect robots on the basis of selected ses- 
sion attributes ([22], [23], [10]). Malignant robots can be detected via traps, 
web navigation behavior analysis, and navigational pattern modeling. Simple 
methods are unlikely to detect malignant robots which are relatively sparse 
in the data. Thus, their detection requires additional efforts. This is why we 
concentrate on cooperative robots in this paper. With the increasing number 
of robots and changes of the identification information of known ones, the 
problem of keeping robot lists current and complete becomes more and more 
laborious. We faced this problem with the development of the robot detec- 
tion tool RDT ([8]) - a specialized web logfile preprocessing software enabling 
researchers to effectively work with and understand large logfile data - one 
of the main requirements to effectivly remove robot requests from web usage 
data and to accomplish further web mining steps. 

In the follwing the Web Data Preprocessing process will be divided into 
the substeps sessionizing, and robot detection. Both steps are supported 
by the RDT software. It speeds up preprocessing and therefore enables re- 
searchers to focus on their specific mining tasks. 

2 Web Data Preprocessing 

Every Webserver records served HTTP-requests in its logfile. In the following, 
the wide spread combined logfile format ([4]) is used, which most HTTP 
servers can create. This format contains the following nine fields: [IP address] 
as client IP address, [name] as name of the user (usually unused), [login] as 
login-name of the basic HTTP-authentication, [date] as date and time of the 
request, [request] as HTTP-request containing the request method, the URL 
of the requested resource (page), and the desired HTTP-protocol, [status] as 
3-digit status code returned by the server, [size] as number of bytes actually 
returned by the server, [referrer] as URL of the referencing page and [agent] as 
name of the client agent. HTTP-requests are the basis for web usage mining 

([13], [14])- 



2.1 Sessionizing 

Each HTTP-request is written in the order of occurance into the server logfile 
and the construction of contiguous user requests requires further efforts. An 
overview of different types of sessionizers and their performance is given in [7] . 
In [13] a navigational path construction algorithm as basis for establishing 
sessions is described. For this paper, we selected a widely used heuristics 
from [12] where requests with the same agent and IP address are grouped 
together as long as the maximum idle time between two requests is smaller 
than 30 minutes. A common user session consists of two kinds of requests: 
main requests as result of an user action and auxiliary requests. Auxiliary 
requests are automatically issued by browsers to retrieve objects referenced 
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by the main request (e.g., stylesheets, images, background sound). If possible, 
we try to assign auxiliary requests - on basis of the referrer field - to their 
main requests. 



2.2 Robot Detection 

Sessions are seen as sessions of human users until hints for the opposite are 
found. Sessions with requests for files that are known to be never requested 
by human users (e.g., robots.txt, some hidden linked files from traps ([20] 
or typical files from worm attacks (e.g., cmd.exe for Nimbda ([16])) provide 
good hints for robot detection. All these files are stored in the trapfile list. 
Robots that obey to the robot exclusion standard identify themselves with 
an agent tag that can be recognized as the agent of a robot. Those tags are 
collected in the robot agent list. Some IP adresses are known to be solely used 
by robots (e.g., the google bots) and can be saved in the robot IP list. The 
composition of these lists can be simplified by assimilating the list of known 
robots available from http://www.robotstxt.org/wc/robots.html ([24]). 
Figure 1 summarises what could be called robot detection heuristics. 

function IsRobotSessionC Session ) 

{ 

if (session contains a request of a file from the trapfile list) 
then return TRUE; 

if (session agent is contained in the robot agent list) 
then return TRUE; 

if (session IP is contained in the robot IP list) 
then return TRUE; 
return FALSE; 

} 



Fig. 1. Robot detection heuristics 



The magnitude of logfile data requires the application of web mining tools. 
Specialized software like our RDT can support researchers with respect to 
data understanding and functions of data preprocessing. Because of space 
restrictions properties of RDT have to be described in a different paper. 

3 Empirical Results 

We tried to find out whether robots influence web mining results. The logfile 
used in this paper originates from a mid-sized online shop. The whole dataset 
(all sessions), the part without robots (user sessions, 73%), and the part 
without users (robot sessions, 27%) were examined and compared. First, we 
selected some simple but wide-spread features (e.g., top N, top entry, top exit 
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pages) which are used by many common logfile analysing tools like webalizer 
([6]). Second, we calculated selected e- metrics from [21] and micro conversion 
rates from [15] for the three datasets. Third, as a more specific application, 
we looked for association rules ([1] , [13] ,[14] ) within the different datasets and 
compared the results. 

The results of the simple features are summarized in table 1 (Top N list of 
most frequently requested pages), table 2 (Top entry list of most frequently 
requested entry pages), and table 3 (Top exit list of most frequently used 
exit pages). The shadowed outcomes show that 7 positions out of the first 
16 highest ranked pages of the top N list are affected by robots. A similiar, 
even stronger effect can be observed in the top entry list (11 differences out 
of the first 16 positions) and also in the top exit list (6 differences out of 16). 
Results of this kind can be used for improvements of the website. 



Table 1. Top N list of most frequently requested pages 



URL 


All sessions 


User sessions 


Robot sessions 


of page 


Position 


Position 


Position 


/ 


1 


1 


1 


/ shop / show / de 


2 


2 


5 


/ shop / show / show-basket .php3 


3 


3 


3 


/shop/templates/basket .php3 


4 


4 


11 


/ shop/show/show_search.php3 


5 


5 


65 


/ zaubertricks.htm 


6 


6 


17 


/de/termine.htm 


Y,sg- jjr 




2 


/de / gewinnspiel.htm 






6 


/de/index.htm 




o 


4 


/ shop/templates/order _adrform.php3 






- 


/ shop / templates / order_finish.php3 


;ft 




- 


/ de /information .htm 






7 


/ de /kontakt .htm 


ii 




8 


/shop/images/tr.gif/ 


14 


14 


- 


/admin/onedit / fr Jeer 


15 


15 


- 


/ de/newsletter.htm 


16 


16 


10 



The influence of robots on the generic e-metrics hit-to- visit (1) (percentage 
of sessions with more than 1 request), hit-to- visit (2) (percentage of sessions 
with more than 2 requests), and avg. visit depth (number of pageviews) is 
rather small in contrast to the strong distortion with respect to the avg. visit 
duration (cp. table 4). The influence of robots on micro conversion rates as 
visit-to-basket (percentage of visits with basket usage), basket-to-buy (per- 
centage of sessions with basket usage that lead to purchases) , and visit-to-buy 
(percentage of visits with purchases) is small but relevant (cp. table 5). Here, 
one can see that robots never buy. 
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Table 2. Top entry list of most frequently requested entry pages 



URL 


All sessions 


User sessions 


Robot sessions 


of entry page 


Position 


Position 


Position 


/ 


1 


1 


1 


/ shop / show / de 


2 


2 


4 


/zaubert ricks . htm 


3 


3 


12 


/ de /gewinnspiel.htm 


4 


5 


5 


/de/index.htm 


’S: 


8 


3 


/ shop / show / show-basket .php3 


6 




16 


/shop/show/show_search . php3 


7 


4 


148 


/ shop / templates /order _adrform.php3 


8 


7 


- 


/de / information.htm 




JÖ 


7 


/kartentricks . htm 


10 


0 


32 


/de/ termine.htm 


11 


12 


2 


/ de /kontakt .htm 




11 


6 


/de/ newsletter.htm 




13 


9 


/de/links.htm 


—ff 


17 


13 


/de/agb.htm 


i— 


1$ 


11 


/ taschenspielertricks.htm 


1 


14 


46 



Table 3. Top exit list of most frequently used exit pages 



URL 


All sessions 


User sessions 


Robot sessions 


of exit page 


Position 


Position 


Position 


/ 


1 


1 


1 


/shop/show/de 


2 


2 


3 


/ zaubertricks.htm 


3 


3 


14 




4 


4 


18 




5 


5 


60 




6 


6 


7 


/de/kontakt.htm 


7 


7 


6 


/de/index.htm 


8 


8 


4 


/de/ ter mine . ht m 


1 1 




2 


/kartentricks . htm 


10 


r—m 


34 


/ shop / images / 1 r . gif/ 


11 


L _s 


- 


/de/information.htm 


1 12 


ii 


5 


/de/agb.htm 


13 


13 


10 


/de/links.htm 


14 


14 


12 


/ de/newsletter. htm 


15 


ie 


9 


/ de/wir _ueber_uns.htm 


15 


18 


13 
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Table 4. Results of e- metrics analysis 



Selected e-metrics 


All sessions 


User sessions (73%) 


Robot sessions (27%) 


Number of sessions 


52295 


38227 


14068 


Hit-to-visit(l) 


37363 (71%) 


29728 (77%) 


7635 (54%) 


Hit-to-visit(2) 


29700 (56%) 


24971 (65%) 


4729 (33%) 


Avg. visit depth 


16 


16.6 


14.5 


Avg. visit duration 


580s 


236s 


1512s 



Table 5. Results of micro conversion rate calculations 



Micro 


I Sessions with 


more than 1 pageview 


conversion rate 


All sessions User sessions Robot 


sessions 


Visit-to-basket 


3.5% 


4.2% 


0.7% 


Basket-to-buy 


31.4% 


32.7% 


0% 


Visit-to-buy 


1.0% 


1.4% 


0% 



Table 6. Selected results of association rule mining 





All sessions 


User sessions 


Robot sessions 


Number of rules found 


9 


19 


3 


Number of interesting rules found 


4 


6 


3 


Association rule 


| (Support, Confidence) 


{/shop /show/de} => 

m 


(30.1%, 58.7%) 


(37.6%, 59.4%) 


_ 


{/zaubertricks.htm} => 
{/} 


(10.2%, 68.1%) 


(12.8%, 69.8%) 


■ 


{ /de/informat ion. htm} => 
{/shop/show/de} 


(3.1%, 65.5%) 


(3.6%, 62.9%) 


■ 


{/de/informat ion. htm, 
/shop/show/de} => {/} 


(3.1%, 65.3%) 


(3.5%, 64.3%) 


■ 


{ / shop / show / show-search . php3 } 
=> {/shop/show/de} 




(3.7%, 50.5%) 


“ 


{ /de/ gewinnspiel , 
/shop/show/de} {/} 


“ 


(3.0%, 64.5%) 


■ 


{/de/newsletter.htm} 

{/de/gewinnspiel.htm} 




“ 


(3.0%, 53.1%) 


{/de/newsletter.htm} => 
{ /de/ index . ht m } 


" 


“ 


(3.0%, 52.2%) 


{/de/newsletter.htm} => 
{/de/kontakt.htm} 


- 


" 


(3.0%, 51.3%) 
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AprioriPre ([9]) and apriori ([11]) were used for association rule mining. 
Support was set to 3% and confidence to 50% to limit the number of rules. 
Table 6 displays the rules which where found. Uninteresting rules reproduce 
facts already known (order_finish => show-basket is such a rule if one cannot 
purchase without usage of the basket). Based on the selected support and 
confidence parameters the underlying dataset contained 4 interesting rules 
for all sessions. Two additional rules were found when only user sessions were 
evaluated. For the robot dataset completely different rules would have to be 
taken into consideration. 

4 Conclusions and Outlook 

Empirical results show that robots can seriously influence web mining. Some 
new aspects and distortions were discovered thanks to our robot detection 
efforts. The developed robot detection tool RDT can simplify and accelerate 
the logfile preprocessing step. It enabled us to effectively remove robot ac- 
tivities in large logfiles and it facilitated data understanding. The problem of 
detecting malignant robots will be addressed in a forthcoming paper. 
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Abstract. Web site visitors who look for desired items can formulate search queries 
which are taken by recommender systems to provide support within the underlying 
buying situation (e.g., enabling users to view recommended items and buy the ones 
they find most appropriate). Data from a large German retail online store is used 
to visualize products viewed most frequently together with search profiles that 
represent identical search queries of larger subgroups of site users. Comparisons 
between products viewed most frequently and those purchased most frequently can 
be used to improve the generation of recommendations. The results give interesting 
insights concerning the searching, viewing, and buying behavior of online shoppers. 



1 Introduction 

“Recommender Systems” is the label for a methodology that can, e. g., be de- 
signed (among others) to guide online users through complex web sites, huge 
online-stores or any other kind of information that can not be overviewed or 
searched through completely. As this is only one of the many situations in 
which recommender systems can be applied a framework that can be used 
to classify such systems would be of help [2]. </,From an empirical point of 
view, we analyzed data gathered from a large German retail online store 
where a rule-based recommender system for a special product class was of- 
fered to support potential buyers. Customers received a sorted list of items 
of the underlying product class that “best” matched their search queries. 
We conducted multidimensional scaling (MDS)[1] to visualize the different 
search queries together with recommendable items of the product domain. 
This allowed us to analyze the searching behavior of site visitors on the basis 
of the most frequently chosen search queries, to compare user preferences 
with respect to the most appropriate products displayed within the MDS 
approach according to the distances between the positions of search queries 
and product locations in the underlying space, and to find out distinctions 
between viewing behavior (products viewed most frequently) and buying be- 
havior (products purchased most frequently). The results revealed important 
hints on how to further improve the generation of recommendations. 
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2 Recommender Systems 

A recommender system is software that collects and aggregates information 
about site visitors (e.g. buying histories, products of interest, hints concern- 
ing desired/desirable search dimensions or other FAQ) and their actual nav- 
igational and buying behavior and returns recommendations (e.g. based on 
customer demographics and/or past behavior of the actual visitor and/or user 
patterns of top sellers with fields of interest similar to those of the actual con- 
tact) [3]. Based on such a general description, different target groups for the 
application of recommender systems can be mentioned, e. g., web site visitors 
(help with respect to site navigation), online shop operators (support with 
respect to site structure optimization), or product managers (recommenda- 
tions with respect to product line design). Taking these considerations as a 
starting point for our analyses, we were particulary interested in visualizing 
the lists of available, recommended, viewed and/or purchased products of a 
retail online shop to support the operation of a recommender system designed 
to assist site visitors with respect to their buying process. Multidimensional 
scaling seemed to be an appropriate methodology for this purpose. 



3 Property Fitting and Search Query Positioning 
Within MDS 



Multidimensional Scaling (MDS) is the label for a class of methods that 
represent similarity or dissimilarity values with respect to pairs of objects as 
distances between corresponding points in a low-dimensional metric space [1]. 
Graphical display of the object representations as provided by MDS enables 
to literally ’’look” at the data and to explore structures visually. A popular 
and classical technique to construct such object representations is the Kruskal 
method [4] . The goodness of fit of the solution obtained within the different 
iterative steps of the method can be assessed by the so called Kruskal stress. 

One weakness of classical MDS is the difficulty to interpret the object 
representations in the low-dimensional space. This problem can be over- 
come by property fitting. Let O = {c>i,...,Ojv} be the set of objects and 
b n = {b n i, . . . , b n M), n = 1, . . . , iV, the representation of object o n in the un- 
derlying M-dimensional target space. If additional information about the ob- 
jects is given, e.g., in form of attribute vectors a p = (ai p , . . . , a^p)' for prop- 
erty p, p = 1, . . . , P, one can construct property vectors c p = (c p i, . . . , c p m) 
so that the projections 

M 

bnp = ^ ^ Cprnbnm ( 1 ) 

m= 1 




191 



of b n onto c p approximate the actual attribute values of the objects as good 
as possible with respect to the least squares criterion 

N 

^ ^ {^np ~ Q"np) • ( 2 ) 

n = 1 

Vector notation leads to c p = (B'B)~ 1 B f a p with B = ( b nm ). Quality of fit 
can be measured by correlation coefficients between a np and a np . 

Similarly we performed the subsequent transformation of the search queries 
s q = (s q i , . . . ,s q p Y where the notation search profile is used for a set 
of at least 10 identical search queries by different web users. Here, p = 
1, . . . , P q , P q < P, indicates properties specified in the query. In cases where a 
range of values was stated, e.g., for the price, we set s qp equal to the mean ob- 
tained from the lower and upper boundaries of the specified range. With given 
property vectors c p we looked for the representation z q = (z q i, . . . , z q M) f of 
s q so that the projections 



M 

S qp = E ZqmCpm (3) 

m — 1 

of z q onto c p approximate the actual attribute values of the search profiles 
as good as possible with respect to the least squares criterion 

P q 

(Sqp ~ s qp ) 2 * (4) 

p= 1 

Vector notation leads to z q = ( C , q C q )~ 1 C / q s q with C q = ( c prn ). 

4 Empirical Analysis 

4.1 Prerequisites 

For our empirical analysis we used a set of transaction data gathered over a 
time period from February 5, 2003 until Juli 28, 2003 from a recommender 
system installed to support the searching behavior with respect to the prod- 
uct class “digital cameras” of website visitors of a large German retail online 
store. Products were described by price, manufacturer, optical zoom, digital 
zoom, resolution, memory, manageability and 19 other features which we ag- 
gregated to flash, manual control and extras. In this way we ended up with a 
bunch of ten product properties. Users can formulate a search query by spec- 
ifying their preferred values in these 10 dimensions. They are then presented 
a sorted list of products that best match their needs according to an internal, 
rule-based algorithm. Implicit customer feedback is measured by counting 
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the number of product views which are indicated by clicks on the product im- 
age to receive further, more detailed information about the product, and the 
number of purchase events which are indicated by clicks on the ”to-market- 
basket”-icon. The product catalog consisted of 259 products. Based on the 
10 dimensions discussed earlier only 181 different positionings of products re- 
mained Thus, it may happen in a few cases that the location of a frequently 
viewed or purchased product actually describes more than one product (with 
differences in those features that we aggregated to flash, manual control or 
extras). Nearly 70000 search queries appeared in the underlying time period 
(of which unfortunately about 49000 were empty and may result from web 
robots). Approximately 80000 product views and 1200 purchase events were 
recorded. To calculate dissimilarities between products we used the results of 
the dist function from the “R” software package [5] . Multidimensional scaling 
was done with the help of the function isoMDS from the library ’’MASS” [6] 
which is an implementation of Kruskal’s non- metric MDS [4] . For the solution 
in the selected two-dimensional space stress was 0.167 and still “sufficient”. 
Property fitting was implemented by ourselves as described in section 3. The 
correlation coefficients for the property vectors were high (> 0.7) for most of 
the properties. Best fits were achieved for price (0.87) and resolution (0.8), 
the worst for digital zoom (0.54) and brand (0.47). 



4.2 Searching Behavior 

As a starting point, we wanted to visualize the products from the prod- 
uct class just described together with the search queries that users mainly 
specify in the underlying situation. We aggregated identical queries to cre- 
ate so-called search profiles and selected those which represented at least 10 
queries. This resulted in 144 search profiles representing 4991 of 22779 search 
queries (21.9%). These search profiles were mapped into the selected percep- 
tual space as described in section 3. If only one search criteria was specified, 
we represented this profile as a point on the corresponding property vector 
instead of depicting a whole subspace (line through that point orthogonal to 
the considered property vector) since the space representation would have 
become unreadable otherwise. The result is shown in figure 1. 

Two characteristics are remarkable: First, many search profiles are posi- 
tioned on distinguishable lines. The ones on the negative prolongation of the 
price vector represent search profiles in which only the desired price was spec- 
ified. The ones on the other dominant lines result from profiles, where mostly 
optical zoom and price were specified but only the price varied. Optical zoom 
was normally set to ’’two- fold” in these cases. Second, many search profiles 
are situated in an area which indicates demand for high memory where in 
contrast only few products are shown. This could be a hint, that customers 
look for cameras with higher memory than the actually available cameras 
can offer which could lead to dissatisfaction with the product assortment and 
reduce willingness to buy. This was confirmed by the observation of product 




193 




experts that most customers who purchased a digital camera also bought 
additional memory sticks/cards together with the selected camera. 



4.3 Viewing and Buying Behavior 

Next, we wanted to examine relations between searching, product viewing 
and buying behavior of the underlying web visitors. For each search profile 
we identified the products viewed most frequently and connected graphically 
their locations with the corresponding search profile position by lines. For 
three of the most frequent search profiles this is shown in Figure 2. One 
can see that in general users view products which are positioned relatively 
close to their specified search profile. However, for all search profiles there 
are products which are even closer and have not been viewed frequently and 
others that are relatively far away but had been viewed very often. Comparing 
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these products with the actual recommendation list - which was not included 
in our data set - could give some important hints how to further improve the 
generation of recommender system results. 




Fig. 2. Selected search profiles and products viewed most frequently 



The same is valid for the corresponding analysis for the purchased prod- 
ucts. Figure 3 shows that the products most frequently purchased are not 
necessarily the ones closest to the specified profiles. They might not even be 
among the most frequently viewed ones. This could, perhaps, be explained 
by what we sometimes call ’’Porsche effect”: People are very interested in 
outstanding products but they buy the standard and cheaper alternatives. 
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Fig. 3. Selected search profiles and products purchased most frequently 



5 Conclusions 



In this paper we argued that twodimensional representations of products of 
a given product class, search queries and recommender system results as well 
as those products viewed and/or purchased most frequently can be obtained 
by MDS and displayed together in appropriate spaces to help to visualize the 
performance of complex recommender systems and the usage of recommender 
system results by web site visitors. We showed that these visualizations can 
create valuable insights for product managers as well as for recommender 
system engineers. We restricted the presentation in different aspects. First, 
representations are based on distances in the underlying space. Second, only 
an actual snapshot of the system is represented. Further work will have to 
address both problems. 
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Zusammenfassung Kontexteffekte können im Zusammenhang mit Neuprodukt- 
einführungen eine entscheidende Rolle spielen. Sie wurden bislang primär in Ex- 
perimenten nachgewiesen. Die vorliegenden Simulationsstudie untersucht die 
Leistungsfähigkeit eines neuen Ansatzes, der es erlaubt Kontexteffekte in Scanner 
Panel Daten zu messen. 



1. Einleitung 

Die erfolgreiche Einführung eines neuen Produktes wird üblicherweise zu einer 
Veränderung der Markstruktur führen. Eine Erklärung sind die Veränderungen der 
Präferenzen und Wahrnehmung der Konsumenten. Kontexteffekte können in die- 
sem Zusammenhang eine entscheidende Rolle spielen. Bekannte Beispiele für 
Kontexteffekte in der Markenwahl sind der Attraction-Effekt [6, 7, 12, 9] und der 
Compromise-Effekt [11]. Einige Erklärungsansätze führen diese Effekte auf kon- 
textbedingte Wahrnehmungs Verzerrungen der Konsumenten, insbesondere auf 
Range-, Frequency- [12] und Categorization-Effekte [9] zurück. Kontexteffekte 
wurden primär in experimentellen Studien nachgewiesen. Die meisten experimen- 
tellen Studien sind problematisch, da sie auf einem Experimental- 
/Kontrollgruppen Design basieren und neben der Information über individuelle 
Vorgänge [14] auch die zeitliche Dimension vernachlässigen. Implizit wird von 
einer Symmetrie der Effekte des Erscheinens und des Verschwindens von Alterna- 
tiven ausgegangen [13]. Außerdem betrachten fast alle vorliegenden Studien nur 
den Fall zweier bestehender und einer eintretenden Marke. Somit können keine 
Prognosen für Situationen mit mehreren Marken gemacht werden. Studien mit 
realen Kaufdaten stehen noch immer aus, obwohl sie Aussagen größerer Reich- 
weite liefern können. 

Der Mangel an Untersuchungen mit echten Kaufdaten kann auf methodische 
Probleme zurückgeführt werden. Markenwahlmodelle erscheinen für die Analyse 
von Kontexteffekten auf den ersten Blick ungeeignet. Die o.g. Präferenzeffekte 
verstoßen z.B. bei Annahme unveränderlicher Präferenzen gegen die Regularitäts- 
bedingung und die Independence of Irrelevant Alternatives Eigenschaft (IIA- 
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Eigenschaft), der beispielsweise das Logit-Modell [5] unterliegt. Methodische 
Weiterentwicklungen können kritische Eigenschaften des Logit-Modells überwin- 
den. So beseitigt die adäquate Berücksichtigung latenter Heterogenität die prob- 
lematische IIA-Eigenschaft. 

In dieser Arbeit wird ein Modell von Chintagunta [4] zur internen Markstruk- 
turanalyse aufgegriffen, das neben der Erfassung von latenter Heterogenität über 
einen Finite Mixture (FM) Ansatz, die Schätzung einer Präferenzstruktur im 
mehrdimensionalen Wahrnehmungsraum erlaubt. Es lässt explizit Korrelationen 
zwischen den Nutzen von Alternativen zu, die den wahrgenommenen Ähnlichkei- 
ten entsprechen [3]. Mittels einer einfachen Erweiterung des statischen Modells zu 
einem Modell über zwei Perioden können auf der Ebene individueller Scanner 
Panel Daten die Eintrittseffekte neuer Marken gemessen werden. Mit Hilfe von 
Modellrestriktionen lassen sich verschiedene Hypothesen über Kontexteffekte auf 
die Präferenzstruktur statistisch testen. 

Ziel der vorliegenden Studie ist es, die Leistungsfähigkeit des erweiterten Mo- 
dells in der Messung von Präferenzeffekten zu überprüfen. Eine Simulationsstudie 
in Anlehnung an die Arbeiten von Andrews, Ansari & Currim [1] und 
Andrews, Ainslie & Currim [2] (im folgenden als AAC bezeichnet) untersucht die 
Fähigkeit zur Ermittlung unterschiedlicher Präferenzeffekte in verschiedenen 
Markteintritts-Szenarien und unter verschiedenen technischen Bedingungen. 



2. Die Berücksichtigung des Markteintritts im Finite 
Mixture Logit-Modell mit Präferenzstruktur 

Die bedingte Wahrscheinlichkeit, dass Haushalt i mit gegebenem Parameter vektor 
6i ={ßoi , ßi } im Zeitpunkt t die Marke j wählt, lautet 

p exp(ß 0lj + ß,'X ijt ) . (1) 

Z ex P CÄa + ßi' x m) 

1 = 1 

Dabei misst ßi die Response auf die Kovariaten Xy t wie den Marketing Mix und 
ßoij spiegelt die Präferenz des Haushaltes i für die Alternative j wider. Dieser Term 
wird als intrinsische Markenpräferenz oder Präferenzkonstante bezeichnet. Das 
FM-Logit-Modell [8] nimmt an, dass die individuellen Parameter 6 t einer diskre- 
ten Heterogenitätsverteilung entstammen, die aus einer finiten Mischung von 
Parametervektoren und zugehörigen Wahrscheinlichkeiten p(Q s ) gebildet wird, mit 

2>(0,)=i- 

j=i 

Unter der Annahme, dass die intrinsische Markenpräferenz eine lineare Funkti- 
on d unbeobachtbarer, markenspezifischer Attribute ist, kann der Präferenzvektor 
in ßoi =ÄWi zerlegt werden [4]. Die Matrix A der Größe jxd beinhaltet die Attri- 
butausprägungen für jede Marke. w t sind die Nutzengewichte, die Haushalt i ei- 
nem bestimmten Attribut zuweist. In diesem Ausdruck sind nur die Präferenzge- 
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wichte haushaltsspezifisch, während die Attributausprägungen der Alternativen 
über alle Haushalte gleich und zeitinvariant sind. Die Nutzengewichte, die Dimen- 
sionen des Attributraumes sowie die unbeobachtbaren Ausprägungen der Alterna- 
tiven auf diesen Dimensionen müssen geschätzt werden. Die konditionale Kauf- 
wahrscheinlichkeit ergibt sich unter Berücksichtigung einer Präferenzstruktur als 

_ exp (a J w i +ß i 'X Vt ) (2) 

ijt J 

L exp(a, w,. + ß t ' X m ) 

/= 1 

Ändert sich innerhalb des Untersuchungszeitraumes durch das Eintreten einer 
neuen Marke das Choice Set, kann dies die Präferenzstruktur und damit die Nut- 
zen beeinflussen. Eine Veränderung der Präferenzen für die existierenden Marken 
bewirkt, dass die Markenwahlwahrscheinlichkeiten nicht nur infolge des größeren 
Choice Sets proportional sinken, sondern sich auch zueinander verändern. Unter 
der Annahme unabhängiger Käufe über alle Zeitpunkte, die sich nun über zwei 
Betrachtungsperioden £=1,2 mit unterschiedlichen Alternativenmengen ist 
eine Teilmenge von M^ 2 ) erstrecken, kann die Likelihoodfunktion eines Haushal- 
tes i als 







(3) 



spezifiziert werden. Hier wird vereinfachend angenommen, dass die Wahrschein- 
lichkeiten der latenten Segmente p(0 s ) gleich bleiben. Die Kaufwahrscheinlichkeit 
Pu. kann entsprechend (2) modelliert werden. Wir bezeichnen dieses Modell im 
folgenden als 2PCH. Die Parameter werden simultan für beide Perioden geschätzt. 
Ausgehend von der restriktivsten Spezifikation, keine Veränderung der Präferen- 
zen für bestehende Marken, können Markteintrittseffekte durch die Freisetzung 
von Parametern zugelassen werden. Das 2PCH-Modell lässt inhaltlich verschiede- 
ne Modifikationen der Präferenzstruktur zu. Modellrestriktionen können sowohl 
auf die Attribute (Wahrnehmung) als auch auf die Nutzengewichte (Präferenzen) 
gelegt werden, sie können einzelne Marken und einzelne Segmente betreffen. 
Somit ermöglicht der 2PCH Ansatz explizit zwischen den verschiedenen Kontext- 
effekten zu differenzieren. Tabelle 1 gibt einen Überblick über die im Rahmen 
dieser Studie untersuchten Spezifikationen. Das 2PCH Modell benötigt zur Abbil- 
dung des Kaufverhaltens im jeweiligen Szenario deutlich weniger Parameter als 
das FM-Modell ohne Präferenzstruktur nach (1) (vgl. Tabelle 2). 



3. Das Design der Simulation 

Der Aufbau der Simulationsstudie ist an der Arbeit von AAC [2] orientiert. Vier 
technische Faktoren, von denen erwartet wird, dass sie die Leistungsfähigkeit der 
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Modellbestimmung und Schätzgenauigkeit beeinflussen, werden experimentell 
manipuliert: 

Faktor 1: Anzahl der Marken vor und nach Eintritt: 5/6 oder 8/9 
Faktor 2: räumliche Konzentration der Marken: hoch oder gering 
Faktor 3: Heterogenität innerhalb der Segmente: cr=0,5 oder < j = 0,25 
Faktor 4: Heterogenität zwischen den Segmenten als Unterschiedlichkeit der 
Präferenzstrukturen: Präferenzwinkel insgesamt < 90° oder > 90° 

Nur der Faktor 1 ist in der Realität beobachtbar. Da FM-Modelle keine within- 
Segment Heterogenität abbilden können, ist Faktor 3 ein Test für die Robustheit 
der Schätzung bei Verletzung der Annahme von Homogenität innerhalb der Seg- 
mente. Darüber hinaus prüft dieser Faktor die Robustheit der unterstellten linearen 
Präferenzstruktur. Durch die verbleibende Heterogenität innerhalb der latenten 
Segmente gilt das Präferenzvektormodell für die Konsumenten nur annähernd. Die 
individuellen Abweichungen sind um so gravierender, je größer die Streuung 
innerhalb der Segmente ist. Die Konsequenzen mehr oder minder starker 
Verletzungen auf individueller Ebene werden in den Modellergebnissen sichtbar. 
Je schwächer die Trennung zwischen den Segmenten, d.h. je höher die Korrelation 
zwischen den Präferenzkonstanten über die Segmente ist, desto schwieriger ist die 
Zerlegung in Positionen und Präferenzgewichte. Die Präferenzkonstanten zweier 
Segmente sind daher um so höher korreliert, je ähnlicher ihre Präferenz Vektoren 
sind. In der Studie wurde die Summe der jeweils kleinsten Winkel zwischen anei- 
nandergrenzenden Vektoren als Kriterium zugrundegelegt und auf zwei Stufen 
variiert. Die Präferenzvektoren sind relativ ähnlich, wenn sie zusammen einen 
Winkel kleiner als 90° aufspannen, sie sind relativ unähnlich, wenn sie einen 
Winkel größer 90° aufspannen. Die Clusterung von Marken im Wahrnehmungs- 
raum, die aus hoher Ähnlichkeit der Präferenzen für verschiedene Marken inner- 
halb der Segmente resultiert, könnte ebenfalls die Schätzung des Präferenzmodells 
erschweren. Sowohl die räumliche Konzentration der Marken im Wahrnehmungs- 
raum als auch die Ähnlichkeit der Präferenzen der latenten Segmente reflektieren 
den Wettbewerb einer Produktkategorie. 

Eine Reihe von Faktoren können in dieser Studie nicht manipuliert werden, 
wenngleich diese in AAC [2] ebenfalls einen Einfluss auf die Güte der Modell- 
schätzung hatten. Um den Umfang der Untersuchung handhabbar zu halten, wur- 
den für diese Faktoren Ausprägungen zugrunde gelegt, die realistischen und 
durchschnittlichen Ausprägung in empirischen Studien entsprechen. Die Anzahl 
latenter Segmente beträgt drei, die Stichprobengröße beträgt pro Periode 4500 
Beobachtungen und die Mixture Komponenten sind gleichgroß, d.h. jeder Haus- 
halt gehört mit einer Wahrscheinlichkeit von 33,3% zu einer der drei Komponen- 
ten. Aus den manipulierten technischen Faktoren ergeben sich somit 2 4 =16 expe- 
rimentelle Bedingungen, unter denen die Veränderung der Präferenzstruktur un- 
tersucht werden soll. 

Für jede technische Bedingung werden 5 Markteintrittsszenarien simuliert, die 
durch die Eintrittsposition der neuen Marke und die Wirkung auf die Präferenz- 
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Struktur gekennzeichnet sind. Sie stellen eine Auswahl der wichtigsten, von der 
Kontexteffekt-Forschung dokumentierten Effekte dar. 

Szenario 1: beliebige Eintrittsposition, kein Effekt 
Szenario 2: dominierter Eintritt gefolgt von Präferenzverschiebung 
Szenario 3: extremer Eintritt gefolgt von Wahrnehmungs Veränderung 
Szenario 4: extremer Eintritt gefolgt von Präferenzverschiebung 
Szenario 5: assimilierter Eintritt gefolgt von Wahrnehmungs Veränderung 



Tabelle 1 . Modellrestriktionen zur Repräsentation von Kontexteffekten 





Theoretische Annahme 


Modellspezifikation 

R: restringiert 
F: frei schätzbar 




1 Kntrv 


Effekt 


A 


w 


Hi 


Nullmodell 


F 


F 


H 2 


beliebig 


kein Effekt 


R 


R 


H,4, 


dominiert 


Präferenzeffekt: 

Attraction-Effekt 


R 


F [wj 


H3.4.5 i 


extrem 


Präferenzeffekt: 

Compromise-Effekt 


R 


F K] 


H 6 1 


extrem 


Wahmehmungseffekte: 
Range-Effekt 
Frequency -Effekt 


F [Alle] 


R 


1 

H 7 ,8 1 


extrem 

assimiliert 

compromise 


Wahmehmungseffekte: 
Range-Effekt 
Categorization - Effekt 
Frequency -Effekt 


V [Set] , R 


R 



Es ergeben sich insgesamt 80 Datensätze, die jeweils eine pre- und post-entry- 
Periode sowie eine Validierungsperiode umfassen. Das 2PCH Modell wird für 
jeden Datensatz auf die acht in Tabelle 2 skizzierten Hypothesen getestet. Da 
Präferenzeffekte in jedem der drei Segmente auftreten können, werden drei Mo- 
delle geschätzt, die auf den Attraction-Effekt (Szenario 2) und den Compromise- 
Effekt (Szenario 4) testen. Wahrnehmungseffekte können den gesamten Wahr- 
nehmungsraum und somit alle Alternativen betreffen oder sich auf einzelne Mar- 
ken beschränken. Aus diesem Grund werden für die Wahrnehmungseffekte je- 
weils drei Modelle geschätzt, die die Menge betroffener Marken sukzessive ein- 
grenzen. Im Null-Modell werden sämtliche Koordinaten und Gewichte der zwei- 
ten Periode neu bestimmt, während das restriktivste Modell Gleichheit sämtlicher 
Koordinaten und Gewichte in beiden Perioden unterstellt. Da der Fokus der Studie 
auf der Überprüfung verschiedener inhaltliche Hypothesen liegt, wurden die 
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Gruppengrößen auf den wahren Wert fixiert. 1 In Anbetracht des Rechenaufwandes 
wird für jede der 80 Bedingungen eine Replikation generiert. Für das gesamte 
Design sind insgesamt 80x8 = 640 Modellschätzungen erforderlich. 

Jeder Datensatz umfasst 450 Haushalte, die jeweils maximal 10 Käufe in jeder 
der beiden Betrachtungszeiträume sowie 5 zusätzlich Holdout Käufe in der Post- 
Entry Periode tätigen. Als exogene Variablen wurden Display, Handzettel (binär) 
und Preis (kontinuierlich) simuliert. Die binären Variablen wurden per Zufallszie- 
hung so erzeugt, dass sie mit einer Wahrscheinlichkeit von 10% bzw. 15% den 
Wert Eins annehmen. Die Preis variable ergibt sich aus der Integration von regulä- 
rem Preis und Aktionspreis über eine dritte binäre Variable Promotionaktion mit 
15% Wahrscheinlichkeit. Um die Identifikation und Genauigkeit der Parameter- 
schätzung zu gewährleisten, wurden die mittleren Preise so gesetzt, dass für jede 
Marke, unabhängig, ob diese durch hohe oder niedrige Präferenz gekennzeichnet 
ist, insgesamt eine ausreichende Zahl von Käufen vorliegt. Im Gegensatz zu AAC 
[2] wurde zugelassen, dass bestimmte Marken in bestimmten Segmenten nur sel- 
ten gekauft werden. Die Preisvariablen folgen einer Normalverteilung. Die mittle- 
ren segmentspezifischen Parameterwerte, auf die within-Segment Heterogenität 
über Zufallseffekte addiert wird, betragen -2.0 für den Preiseffekt, 0.9 für den 
Displayeffekt und 0.4 für den Handzetteleffekt. Die mittleren Präferenzkonstanten 
wurden so festgelegt, dass sie einem Pre- und Post-Entry Präferenzmodell ent- 
sprechen, das einen der fünf simulierten Effekte aufweist. Die Erzeugung der 
simulierten Kaufdaten entspricht dem üblichen Verfahren [2]. 



Tabelle 2. Anzahl zu schätzender Präferenzparameter a 















FM-Logit- 








2PCH 




modell 


Modell 


Anzahl Marken j 


sh 2 


SH 3A , s 


sh 6 sh 7 


SH s J 


SHj 


nach (1) 


5/6 | 


16 


18 


23 19/20/21 


18/19/20 


27 


30 


8/9 1 


22 


24 


35 28 


26 


39 


48 



a Präferenzparameter für das 2PCH-Modell sind die Gewichte und Koordinaten abzüglich 
notwendiger Restriktionen, um Identifizierung zu erreichen. 



Das Auffinden des korrekten Modells hängt von der Güte der Schätzung des 
Präferenzmodells ab. Die Identifikation des Präferenzmodells wird durch die ma- 
nipulierten Faktoren bedingt. Je ähnlicher segmentübergreifend die Präferenzen 
für Alternativen sind, desto schwieriger wird es, die wahre Präferenzstruktur zu 
ermitteln. AAC [2] haben nachgewiesen, dass die individuellen Parameterschätzer 
im FM-Ansatz bei hoher Heterogenität innerhalb der Segmente, verglichen mit 
den Schätzern des Hierarchischen Bayes-Ansatzes, überraschend gut sind. Wir 
erwarten für das 2PCH Modell, dass die Extraktion der Präferenzstruktur und die 
Identifikation der wahren Szenarien bei hoher Heterogenität innerhalb der Seg- 



1 Für das 2PCH-Modell ist ein schrittweises Vorgehen zur Bestimmung der Anzahl laten- 
ter Segmente und guter Startwerte erforderlich. Erst im letzten Schritt folgt der hier be- 
trachtete Hypothesentest über zwei Perioden. 
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mente schwieriger wird, da die Abweichungen vom unterstellten linearen Präfe- 
renzmodell größer werden. 



4. Ergebnisse 

Tabelle 3 fasst die Ergebnisse für die Trefferquote unter Verwendung alternativer 
Informationskriterien (Akaike’s information criterion (A/C), consistent Akaike’s 
information criterion ( CAIC) und Bayesian information criterion ( BIC )) zusam- 
men. 



Tabelle 3. Modellselektion, Anteil richtig identifizierter Szenarien in Prozent 



technische Faktoren 


BIC 


AIC 


CAIC 


übereinstimmend 
identifizierte Modelle a 


Anzahl Marken 
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93 


88 
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83 
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78 


68 
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Konzentration 


hoch 
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78 




55 




gering 


90 


88 
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75 


Heterogenität 


hoch 


83 


80 


80 


65 


within 


gering 


80 


85 


78 


65 


Heterogenität 


hoch 


78 


85 


75 


63 


between 


gering 


85 


80 


83 


68 


Gesamt 


81 


83 


79 


65 



Ein Modell ist übereinstimmend als richtig identifiziert, wenn es durch alle drei Informa- 
tionskriterien ausgewählt wird. 



1. Den größten Einfluss auf die Leistungsfähigkeit des Ansatzes zur Identifika- 
tion alternativer Präferenz- und Wahrnehmungseffekte haben die Faktoren Anzahl 
der Marken und räumliche Konzentration. Im 5/6-Marken-Fall gelingt es besser, 
das korrekte Szenario zu ermitteln. Der Effekt sinkender Beobachtungen pro Mar- 
ke dominiert offensichtlich den relativen Zuwachs an Freiheitsgraden für das 
Präferenzmodell, verglichen mit dem FM-Modell ohne Präferenzstruktur. 

2. Die Ähnlichkeit der Präferenzen, die sowohl über den Faktor räumliche Kon- 
zentration als auch den Faktor Heterogenität between manipuliert wurde, führt nur 
im ersten Fall zu signifikanten Unterschieden in der Trefferquote, während sich 
die Trennung der Mixture Komponenten in dem hier variierten Ausmaß nicht 
signifikant auswirkt. 

3. Die Heterogenität innerhalb der Segmente hat keinen signifikanten Einfluss 
auf die Treffergenauigkeit. Der 2PCH Ansatz erweist sich als relativ robust ge- 
genüber der daraus resultierenden Verletzung des unterstellten Präferenzmodells. 
Dieses Ergebnis steht im Einklang mit den Erkenntnissen von AAC [2], die dem 
FM- Ansatz eine hohe Robustheit gegen die Verletzung der Annahme von Homo- 
genität innerhalb der Segmente nachgewiesen haben. 
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Insgesamt erzielt der vorgeschlagene Ansatz gute Ergebnisse bei der Aufde- 
ckung des korrekten Szenarios. Unter Verwendung verschiedener Informationskri- 
terien konnte der korrekte Markteintrittseffekt in 65% der Fälle sogar überein- 
stimmend identifiziert werden, während die a priori Wahrscheinlichkeit jedes 
Modells in dieser Studie nur 1/8 beträgt. Im Zweifelsfall kann zusätzlich der Like- 
lihood-Ratio-Test herangezogen werden, da einzelne Hypothesen ineinander ge- 
nistet sind. In vielen Fällen konnten Unklarheiten, die aus unterschiedlichen Er- 
gebnissen der Informationskriterien resultieren, beseitigt werden, so dass die Tref- 
ferquote entsprechend höher liegt. 
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Abstract. To attract web visitors via the internet it is fundamental for all kinds 
of online activities to be ’’visible” in the net. Visibility measurement is important 
for web sites: it helps to define benchmarks with respect to competition and allows 
to calculate visibility indices as predictors for site traffic. 

This paper discusses a new approach to measure online visibility (OV) and compares 
it with one known from the literature. 

We describe physical and psychological drivers of OV and suggest a measurement 
of OV that works automatically as a robot in the internet. Managerial implications 
to make web sites ’’smelly” or ’’visible” are also discussed. 



1 Introduction 

Nearly 80% of all internet users find new web sites with the aid of search 
engines. With this information in mind, search engines appear to be very 
important instruments to get in contact with new customers for whatever 
online business or visitors of web sites in this medium. For example, an in- 
surance broker listed at the first position of the result page of a search engine 
may expect to be frequented by up to 10,000 visitors per month when web 
users look for ” insurance” [6] . A traditional marketing campaign would cost 
several thousand dollars to have the same effect. Hence, it is very important 
to ’’maximize” what could be called online visibility (OV) of web sites, or -at 
least- to improve OV relative to competition. 

In section 2 we describe main drivers of OV and focus on facts about human 
online searching behavior. This leads to a new measure of OV and possibili- 
ties for its determination as discussed in section 3. In section 4 we give some 
managerial implications. Section 5 presents conclusions. 

2 Drivers of Online Visibility 

OV is composed of different parts. Here, we will concentrate on the following 
two: There are psychological drivers of OV derived by human online search- 
ing behavior. Here, questions like how humans use the internet and how they 
interact with search engines have to be taken into consideration. Psycholog- 
ical drivers can decrease OV. Additionally, physical drivers of OV such as 
links to a web site, banner ads, listings in search engines or directories, etc., 
are of importance. They can be influenced by administrators of web sites 
themselves and increase OV. 
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2.1 Psychological Drivers of Online Visibility 



To measure OV it is essential to understand psychological drivers derived by 
human online searching behavior: 

As already mentioned about 80 % of all internet users find new web sites with 
the aid of search engines. Thus, Google , Teoma , etc., are effective instruments 
to reach new visitors or customers [6]. 

In course of time, people become more efficient in using the web by navigating 
directly to a web site they already know, but they use search engines to find 
new ones (see table 1 according to an independent report by WebSideStory , 
Inc. [14]). 



Table 1. Global Internet Usage 



Referral Type 2002 

Direct Navigation 50.21% 

Web Links 42.60% 

Search Engines 07.18% 



2003 trend 
65.48% / 

21.04% \ 

13.46% / 



As global internet usage with respect to search engines has nearly doubled 
from 2002 to 2003 the question is how do internet users interact with search 
engines? There are three main studies covering web searching strategies with 
the help of search engines by analyzing query logs: The Fireball [8], the Excite 
[9], and the AltaVista study [12]. 

In the following we only concentrate on the AltaVista study, since conclusions 
of all three studies are nearly the same. [12] is based on the largest data set 
(one billion queries submitted to the main AltaVista search engine over a 
42-day period) and provides a broad spectrum of information: given number 
of queries in the data set, length of the collection period and analysis, it is 
the most complete web searching study to date. 

Among the facts worth mentioning about human online searching behav- 
ior the following are interesting: 

Nearly 77.6% of all query sessions consisted of only one request. 85.2% of 
searchers examined only one result screen per query (7.5% two, and 3.0% 
three screens). The average number of terms in a query added up to 2.35 (<r = 
1.74) and that of operators (AND, OR, NOT ...) to 0.41 (a = 1.11). According 
to the total number of queries, 63.7% occurred only once, i. e. the formulated 
queries were ’’almost” unique. The most popular term in a query was ”sex” 
with an appearance of 1,551,477 times. This is equal to 2.7% of the total 
number of non-empty queries. 
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2.2 Physical Drivers of Online Visibility 

Dreze and Zufryden [5] defined visibility as the extent of presence of a brand 
or a product in the consumer’s environment. Thus, one can view OV as an 
indicator with respect to potential web site traffic in the same way as aware- 
ness is a precursor to purchase. A web site can draw attention to its content 
and attract potential internet surfers by both offline (television, radio, news- 
papers, etc.) and online (banner ads, links from search engine result pages, 
online directories or other web pages, etc.) means. 

The authors identified three main physical drivers which increase OV and 
can be measured by taking a snapshot of the internet. 

Links from other web sites: One can increase OV by increasing the num- 
ber of incoming links from important or frequently visited web pages. To find 
the amount of incoming links from web pages to the underlying site one can 
use the brute force approach, i. e. crawl the net and keep track of all links lo- 
cated on web sites. This is the common approach of most search engines which 
provide users with a list of these links (fan-ins, inbounds, incoming links). 
Users can retrieve this kind of information by a special command and the 
corresponding URL in the search interface (e.g., ”link:www.xyz.com” with 
respect to Google) and should repeat this procedure for different engines to 
ensure maximum coverage [2]. 

There is a serial position effect in the HTML code that relates to effectiveness 
of links (the higher the rank order of a link the higher the click through rate 
on that link [1]) The hypothesis that the effectiveness of links is also affected 
by the depth of the page on which the link was located (with the home page 
of a web site having a depth of 1) was statistically not significant. 

Online Directories: To become visible in the net it is important to be listed in 
the adequate categories of online directories. Directories or subject catalogs 
that represent the ’’yellow pages” of the internet are characterized by their 
hierarchical structure. The most important property of directories is that 
they are validated by human beings and not by robots. Experts look at every 
page submitted for registration in the index and review it. This procedure 
is generally referred to as manual indexing. One advantage is that a human 
indexer can detect relations between seemingly different contents. But it is 
very time consuming and expensive. Well known examples for directories are 
Yahoo! [15] and ODP [13]. 

Search Engines: Web search engines (also called web indices, index servers, 
or simply search engines) work exclusively with automated methods [11]. A 
collection of high rankings in such engines is one of the best prerequisites to 
yield enhanced OV for new visitors. Dreze and Zufryden [5] took the fact into 
consideration that search engines always return result pages which are for- 
matted in a special way (e.g. 10 links per result page) and that the frequency 
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of looking at the first, second, third ... result page is decreasing. 

In addition, they characterized web sites as trees that surfers explore by go- 
ing up and down branches where less weight was assigned to deep links and 
more to links that are close to the root of the respective site. 

These results gave some insights in how people process online information. 
First, the position of a link on a web page is important for OV. Second, as it 
has not been proved that people view web sites structured in a arborescent 
manner, the depth of a page in the site seems to have little impact on its 
importance. This may be due to the ability of search engines to route people 
directly to that page where the desired information is located. Additionally, 
it should be noted that, in the meantime, it is legalized that search engines 
use these ” deep links” [4] . Third, the results show that visibility of web sites 
in search engines is dependent on both position of the link on and depth of 
the result page on which the underlying link is situated. 

3 A New Approach to Measure OV 

Based on the knowledge of human online searching behavior and the func- 
tioning of ranking algorithms of search engines such as PageRank [3,7,10] we 
can define several (new) impacts on OV. 



3.1 Impacts of Human (Online) Searching Behavior on OV 

One aspect to define a new measure of OV is the importance of fan-ins and 
directory listings on ranking algorithms of search engines. Another aspect 
is related to the searching behavior of internet users. If OV is measured by 
the three physical drivers mentioned before (search engine ranking, incoming 
links, and directory listings) in the same way, some problems may arise. To 
calculate a precise measurement one will have to subtract all overlappings 
and as such a measure doesn’t exist we have estimated OV based on what 
people will definitively see. 

1. The first search engine results visible on the answer screen as a cutout of 
the first result page (in the majority of cases ten entries) will have the 
best chance to be clicked on by a searching person 

2. Human searchers don’t browse every result page of a search engine. They 
only browse a few with exponentially decreasing intensity ( AltaVista 
study [12]). 

3. We do not incorporate the number of results returned by search engines, 
as most search engines return ten entries per result page. 

4. In addition, we consider a measurement of Adwords’ appearance (a spe- 
cial feature of Google) because this is a good instrument for enterprises 
to become visible via up-to-date activities (special offers, sales) in a short 
time with the aid of bundles of keywords. 
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5. We do not use general keywords from keyword databases but propose an 
individualized set of keywords to differentiate web sites by content. 

6. We do not only measure OV with one set of keywords but use a set of up 
to three keywords and all subsets of variations. 

7. As it is not possible to measure OV in directories in an objective way 
(the best-known directories list URLs or names in alphabetical order like 
yellow pages) we omit the determination of visibility via listings in online 
directories. 

8. We count fan-ins to a certain extent: we include incoming links with a 
small factor in order not to overestimate this effect. 

3.2 The New Measure GO Vis 

Our new approach to estimate OV has been called GOVis (Gage of Online 
Visibility) to differentiate it from other measures. It is given by 

IT-x (?)•»■ 

GOVis = 

k= 1 

(i) 

with 

* /C is a set of interesting keywords, with \ JC \= N (normally N < 3), 

(n) * n * the quantity of all ordered subsets of p (/C) \{0} and k 
is the kth subset of keywords with which a query in Google is performed, 

* p is the depth of the result pages of the search engine used (we have 
restricted depth to p < 2), 

* R is the quantity of results per result page and r is the rth ranking 
position on the result pages (we, normally, use Google with R = 10), 

* A is the maximum quantity of Adwords per result page ( Google standard 
is A = 8) and a is the ath Adword ranking position, 

* L is the corresponding URL, Zl is the number of corresponding fan-ins, 

* hkpr is the hyperlink at the rth ranking position on the page with depth 
p generated by a query with the kth subset of keywords, 

* Wkia is the Adword link at the ath Adword ranking position on the page 
with depth 1 generated by a query with the kth subset of keywords, 

1, hkpr links to L v _ J 1, Wkia links to L 
0, otherwise kla \ 0, otherwise 

* a + /J + 7 = l. 

In (1) we excluded measures of OV in directories, on portals, in chat rooms 
or banner ads, etc. We didn’t consider overlappings, but we used different 
numerical values for a, /3, and 7 to consider how GOVis depends on differ- 
ences with respect to the meaning of fan-ins, Adwords or rankings in search 
engine result pages. 
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3.3 Implementation and Results of GO Vis 



We implemented (1) in PHP as a parser. We used Google and Adwords for 
queries (because Google has the most pages in the index). For the quantity of 
fan-ins we considered AltaVista (as in Altavista it is possible to exclude links 
from the home domain (linkrhttp: / /www.xyz.com -host:http:/ /www.xyz.com) 
while Google only saves fan-ins of pages with a high PageRank). In this first 
version of GO Vis it is possible to enter up to three keywords, a special URL 
and to customize a, /?, and 7. 

For results of OV measured by GO Vis we used scenarios with different 
a, /?, and 7 for /C ={Bücher, Dvds, HiFi}, see table 2. 



Table 2. GOVis results 



scenario^ (a, /?, 7 ) 


enterprises 


E^kpr 




HZl ) 


GOVis 


0.15, 0.00, 0.85 


Amazon 1 


3+1 


4 


14.1774 


12.5560 




Ebayi 


0+6 


1 


11.7464 


10.3155 


0.40, 0.00, 0.60 


Amazon 2 


3+1 


4 


14.1774 


9.8536 




Ebay2 


0+6 


1 


11.7464 


8.3722 


0.85, 0.00, 0.15 


Amazons 


3+1 


4 


14.1774 


4.9893 




Ebay3 


0+6 


1 


11.7464 


3.6381 


0.80, 0.15, 0.05 


Amazon 4 


3+1 


4 


14.1774 


4.0032 




Ebayi 


0+6 


1 


11.7464 


2.5030 



In scenario 1 and scenario2 we chose a and 7 on the basis of adjusted figures 
from table 1 of the years 2002 and 2003 without ’’Direct Navigation”. The 
number of users that find new web sites with the aid of search engines in- 
creases while on the other hand fewer users reach new pages over web links. 
In scenarios we defined a and 7 according to PageRank. Here, 7 is the prob- 
ability that a random surfer continues to click on links while with 1 — 7 (s)he 
will jump to any page in the web. In this scenario search engines are the 
best possibility to jump to any visible page in the web (where we have the 
information in mind that 80% of all internet users find new web pages with 
the aid of search engines). 

In scenark>4 we also included the visibility of Adwords to a small extent and 
lowered the impact of incoming links on ranking algorithms. 

As it is important to know more about the navigational behavior of target 
segments to which the efforts to increase OV are directed the calculation of 
a, ß and 7 is essential for managerial implications. 
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3.4 Improvements by GO Vis 

First of all, GO Vis can be individualized, i. e. that for every company and 
their competitors OV is measured by content specific keywords. As GO Vis 
does not use a general list of most common used keywords one can select 
keywords depending on special up-to-date activities (sales, new products). 
This and the fact that we base visibility measurement on human searching 
behavior (only a few keywords for the formulation of a query, only a few re- 
sult pages of the search engine are actually considered) lead to short running 
times to compute OV via GOVis. 

GO Vis is also an effective instrument to control visibility of online activities 
in relation to competitors. It represents a relative measure of OV based on 
special keywords concerning the content of and activities related to the cor- 
responding web site. 

Since a, /3, and 7 are customizable one can calibrate these parameters on 
the basis of new values from new online surveys concerning human searching 
behavior and the way how target segments interact with the internet to find 
web sites. 



4 Managerial Implications 

The scenarios in table 2 show that it becomes more and more important to 
increase search engine visibility, but that it is also important to take into con- 
sideration the searching person itself. Thus, it is not the ultimate to optimize 
a web site for better search engine ranking. In the end, this can be a tit-for-tat 
strategy because search engines will adapt their ranking algorithms to block 
attempts that only optimize web sites with respect to a high ranking posi- 
tion in their result pages. An honest way (with customers /visitors and search 
engines in mind) to improve OV or to make web sites ’’smelly” is to observe 
the log files of the corresponding web site to detect search engine referrals 
that include important keywords of searching persons. Another possibility 
is to sift online keyword databases to compare already used keywords with 
descriptions or text content of the corresponding web site to meet customer 
needs with respect to, e.g., content, special topics or product descriptions. 
In case of up-to-date activities it is advisable to buy bundles of Adwords as 
search engines crawl web sites only every few months, so temporal activities 
won’t be visible. 

5 Conclusion 

In total the measurement of OV should represent a benchmark for specialized 
content or activities and not lead to a strategy to become listed at the first 
position of a search engine result page based on a query corresponding to 
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keywords describing a general topic. There is an impact of the order of key- 
words in a query on visibility, thus, long term optimization of content of the 
corresponding web site has to be considered. Visibility has to be measured 
in constant short term periods as the internet changes ” quickly” . 

The bundle of content visibility, Adwords visibility, search engine visibility, 
and visibility based on incoming links describes the most important instru- 
ments to account for OV. GOVis is a first step in order to measure online 
visibility affects. 
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Abstract 



With the rise of the internet, online brokerage emerged as a fast and cost effective 
way to trade securities. New competitors naturally focused on generating traffic to 
acquire many customers. However, in ebusiness, "natural" exit barriers (e.g., loca- 
tion) lose importance. As competitors are only a mouse-click away, online firms 
must convert first-time users into regular customers to regain acquisition costs. 
But what determines a customer to be committed to his online broker? And, if he 
can be successfully retained, what effect will that have on the company’s profits? 
Based on theoretical research, a generic model for the development, dimensions, 
and behavioral consequences of customer retention are proposed. Using causal 
analysis, this loyalty/dependence-model is successfully tested in online brokerage. 



1 Introduction 



The management goal of "customer loyalty" [8] is typically justified by its propo- 
sed advantages for the suppliers’ profits: repeat purchases, cross-buying, selection 
of higher priced offerings, recommendations to friends, higher tolerance towards 
mistakes [9, 10, 23]. Although these theoretical implications seem intuitive, they 
could only partly be proven empirically. In addition, newly established online 
businesses have not received enough attention in marketing research. 

The following study thus has two main goals: First, the proposed behavioral 
consequences of "customer retention" will be studied within the context of an 
internet-based service provider (an online broker). Additionally, it will be analy- 
zed what determines the development of this desired customer status. Second, the 
study also aims to find out if the distinction of two separate commitment dimen- 
sions is practically relevant (e.g., causes different customer behavior, or are influ- 
enced by diverse determinants). With respect to the outlined research goals, the 
paper consists of two main parts: Chapter 2 contains the theoretical foundations 
which lead to the proposed hypotheses for the empirical test. In chapter 3, the re- 
search design is outlined and the results of the causal analysis will be discussed. 
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2 Theoretical Foundations 



2.1 Dimensions and Determinants of Customer Commitment 

Most research conceptualize the commitment construct by its (assumed) behavio- 
ral consequences [20, 23]. As these effects are to be analyzed, a different approach 
is needed. Consistent with exploratory research of Eggert, customer commitment 
in this study is defined as an "inner state of the customer" towards a specific sup- 
plier [11] and operationalized as a two-dimensional construct: The affective com- 
ponent of customer commitment {loyalty) originates from a sense of attachment to 
the supplier. This appreciation not only indicates higher repurchase intent, but also 
resistance to counter-persuasion and a certain willingness to recommend the provi- 
der to others [9]. The cognitive commitment dimension (spurious loyalty, depen- 
dence) includes the rather involuntary binding of the customer due to constraints 
which hamper his switching to another supplier [11]. Due to the involuntary na- 
ture of the dependence perception, a potential drawback effect ("reactance") can 
be expected towards the level of attitudinal loyalty, resulting in a negative causal 
hypothesis from "dependence" to "loyalty". 

Research within economic (i.e., resource-dependence view, transaction cost 
theory) and customer behavior concepts (i.e., dissonance, learning, risk, social in- 
teraction theory) revealed 5 supposed determinants for customer commitment. The 
first potential cause for high customer commitment is the overall level of satisfac- 
tion which is defined as the result of a cognitive and affective evaluation process, 
during which the customer compares the perceived performance of a supplier with 
its expected or desired performance. The resulting satisfaction level therefore re- 
fers to the aggregate experiences with this provider [15]. Second, it is proposed 
that customer relationships endure because buyers face significant transaction 
costs or other barriers to switch to another supplier. "Switching costs" include fi- 
nancial consequences, but also time, psychological effort, or social constraints 
connected with the migration [16]. Based on this definition, positive influences 
from 3 distinct types of migration barriers - economical, psychological, and social 
barriers to switch - on the level of customer commitment are postulated within the 
research model. Finally, a presumably negative effect on the level of customer 
commitment is postulated to originate from the customers' perception of the vari- 
ety/attractiveness of alternative suppliers available. It is also proposed that attrac- 
tive competitive offerings negatively influence a consumer's satisfaction with the 
current provider and thus indirectly reduce his loyalty. 

2.2 Behavioral Consequences of Customer Commitment 

The effects of higher customer retention can be explained by dividing "profit" into 
its factors "number of customers" and "profit per customer". As the total number 
of customers depends on the retention of current users and the acquisition of new 
clients; increased customer commitment is proposed to have positive effects on 
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customer retention (" continuation of the relationship ") and their intention to com- 
municate positively about their preferred broker (" positive word-of-mouth/refer- 
rals ") which is a credible and cost-effective means of gaining new customers [22]. 

On the other hand, the average profitability per customer typically improves 
during the business relationship [26]; a pattern found to be even more extreme in 
internet businesses [25]. Since profits rise with increasing revenues or falling costs 
per client, they can be attributed to 3 factors: First, as loyal customers tend to con- 
solidate demand at few suppliers, average purchase amounts are likely to rise over 
time and cross-/up-buying might occur (" expansion of the customer relationship ", 
[13]). Second, as committed clients are more likely to be in a habitual purchasing 
mode, they are less likely to take advantage of competitors' offers [10]. Thus, lo- 
wer " price sensitivity " is proposed for long-term customers who, on average, pay a 
price premium [5]. Third, increased customer profits might also be caused by re- 
duced " customer-specific service costs " of ongoing business relationships [1, 26]. 

In total, 5 behavioral consequences of customer commitment were identified 
from existing research. While the "loyalty "-dimension is proposed to exert only 
positive influences on each of the behavioral intentions, "dependence" is assumed 
to have no significant effect on "referrals/word-of-mouth" and negative effects on 
the "expansion of the relationship" or "service costs". Beyond the direct influences 
of customer commitment, the intention to "expand the relationship" will be posi- 
tively influenced by the decision to "continue the relationship". 



3 Empirical Results 



To test the derived hypotheses, structural equation modeling was chosen because 
of its ability to simultaneously test/quantify causal relationships between model- 
exogenous/endogenous latent variables and explicitly integrate measurement error 
into the analysis [2, 14, 17] (for a description of causal modeling refer to [3, 7]). 
Primary data for the study was collected by an online survey of 60,000 online bro- 
kerage users in July 2002. With 4.591 complete questionnaires, the required sam- 
ple size (at least 5 times the number of estimated parameters, [4]) was reached. 
Scales for latent constructs consisted of at least 3 indicators [6]. Variables were 
measured on 6-step, symmetric Likert scales with extreme points of "completely 
(disa)gree" or "very (un)likely". AMOS 4.0 was used for parameter estimation. 

Measurement models of all latent variables were tested as for reliability and va- 
lidity: Each construct was required to show a Cronbach's Alpha (measure of inter- 
nal consistency of all indicators measuring the same factor [18, 24]) of at least 0.7. 
Based on exploratory factor analysis (principal axis factoring, oblique rotation), all 
scale items needed to show sufficient loadings on their proposed factor and ex- 
plain at least 50% of that factor's variability [18]. Confirmatory factor analysis re- 
quired each measurement model to fulfill global/local fit criteria for causal model- 
ling (i.e., GFI > 0,9; AGFI > 0,9; RMR <0,1; NFI > 0,9; individual item reliability 
> 0,3; factor reliability > 0,6; average variance extracted > 50% [3, 4, 19]). 
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3.1 Determinants of Online Customer Commitment 

Five slightly different causal structures fulfilled the outlined fit criteria. The 
best-fitting partial model for the determinants of customer loyalty and dependence 
in online brokerage was selected based on best overall fit achieved with as few es- 
timated parameters as possible. Since all models were ’’nested”, the chi-square-dif- 
ference-test was applied to compare the fit of the causal structures [8, 21]. Figure 
1 contains the best-fitting partial model of the commitment determinants. 




Fig. 1. Best-fitting partial model for the determinants of customer commitment 

All global fit measures of this causal model meet or exceed their target levels. 
In total, the causal structure shows a high explanatory power since 90% of the tar- 
get construct "loyalty" and 68% of the "dependence" -dimension can be explained 
by the included 6 determinants 1 of the two-dimensional customer commitment 
construct. As for the tested relationships, 10 show the postulated sign and statisti- 
cal significance at the 5% level. The supposedly negative path coefficient from 
"dependence" to "loyalty" turns out to be highly significant but with a strong posi- 
tive sign. An explanation for this phenomenon can be found in dissonance theory: 
As an individual seeks to reduce the dissonances that originate from tensions be- 
tween the persons attitudes and his behaviors, the possibly low level of affective 
"loyalty" might in retrospect be increased if the person perceives a high degree of 
"dependence" from his current supplier [12]. By closing the gap between both 



i 



Based on measurement model validation, "economic barriers to switch" were split into 
2 factors: "expenditure-related barriers" and "habituation-caused barriers to switch". 
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commitment dimensions, higher levels of perceived dependence may then trans- 
late into higher declared loyalty towards the provider. 

As some determinants influence the target constructs directly (for example, 
psychological barriers to switch loyalty), while others affect the endogenous 
variables indirectly (e.g., social barriers to switch ^ satisfaction loyalty). To 
quantify the total influence of each determinant towards the customer commitment 
dimensions, direct and indirect effects need to be added (as shown in table 1). 



determinant 


target 

construct 


direct 

effect 


indirect effect(s) 


total 

effect 


satisfaction 


loyalty 


0.34 


0.16 


■I1KM 


social barriers to switch 


— 


0.56 


BBS 


psychological barriers to switch 




0.28 


0.52 


expenditure-related barriers to switch 


-0.17 


0.31 


0.14 


habituation-caused barriers to switch 




0.20 


0.25 


attractiveness of alternative brokers 


— 


-0.03 


-0.03 


dependence 


0.58 


— 




satisfaction 


dependence 


— 


0.15 


0.15 


social barriers to switch 


— 


0.35 


0.35 


psychological barriers to switch 


0.48 


— 


0.48 


expenditure-related barriers to switch 


0.53 


— 


0.53 


habituation-caused barriers to switch 


— 


0.12 


0.12 


attractiveness of alternative brokers 


-0.05 


- 


-0.05 



Table 1. Total effects of the determinants of customer commitment 

Main determinants of the loyalty of online brokerage users are social and psy- 
chological switching barriers (i.e. trust; total effect = +0.56 and +0.52, respective- 
ly) and satisfaction with their current experiences (+0.50). As for perceived de- 
pendence, economic barriers to switch (i.e., expenditure-related switching barriers 
such as the costs of moving one’s brokerage depot to another provider; combined 
effect = +0.65) become more relevant. But psychological and social switching bar- 
riers also remain relevant determinants of the dependence dimension. Attractive- 
ness of other brokers, however, has only limited influence on both components of 
the users' commitment. This might be due to the high costs (including time and 
money spent) for opening up a new account 2 at a different online broker. 

In summary, it can be concluded that an isolated focus on customer satisfaction 
will be of limited success, if other determinants of loyalty and/or dependence are 
neglected. Only a balanced mixture of activities, which simultaneously seek to 
improve several or all determinants of customer commitment, will have a sustain- 
able positive effect on loyalty and its proposed behavioral consequences. 



2 



For multi-depot-customers (37% of surveyed customers), the effect is expected to be 
even stronger since they can more easily switch between various providers. 
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3.2 Behavioral Consequences of Online Customer Commitment 

Again, the accepted model was selected based on overall fit to the data as well as 
the strive to estimate as few parameters as needed. Figure 2 shows the best-fitting 
partial model (based on a chi-square-comparison) for the behavioral consequences 
of high customer commitment levels in the online brokerage business. 

With exception of NFI, all global fit indices show good fit of the model to the 
underlying data. In the structural model, 9 of 12 tested causal relationships could 
be verified with the correct sign and a significance level above 95%. Two more 
path coefficients are only marginally significant, but show the proposed direction, 
while - again - the relation from dependence to loyalty is highly significant, but 
with the opposite sign. Thus, not all of the proposed influences on the 5 behavioral 
intentions can be supported by the data: For example, while the loyalty state exerts 
a strong direct effect onto the word-of-mouth-intention, it shows no significant in- 
fluence onto the willingness to uphold the relationship with the current provider. 




Fig. 2. Best-fitting partial model for behavioral consequences of customer commitment 

Table 2 contains the aggregated information about direct and indirect effects as 
well as their sum. In total, significant effects of the loyalty dimension are only ex- 
erted onto the intention for positive reference (+0.90) and their subsequent will- 
ingness to support first time users referred by them; leading to a possible reduction 
of service costs (+0.82). The dependence factor shows similar, but weaker effects 
on the same two behavioral categories (+0.66 and +0.52), respectively. The stron- 
gest direct effect originating from the dependence dimension results in a slightly 
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reduced price sensitivity of the online brokerage user (-0.23). Interestingly, neither 
the loyalty nor the dependence dimension exert a significant effect on the intention 
of an online brokerage user to continue using his current service provider (not sig- 
nificant and +0.13, respectively). An explanation for this seemingly paradox result 
could be that investment decisions of brokerage users are mainly driven by their 
expectations about the performance of stocks or bonds; and only to a minor extent 
by their loyalty towards their preferred online broker. The same reasoning also 
applies to the online brokerage user’s intention of expanding the relationship. 



commitment 

dimension 


customer behavioral inten- 
tion 


direct 

effect 


indirect effect(s) 


total 

effect 


loyalty 


continuation of relationship 


— 


— 


-- 


expansion of relationship 




— 


0.12 


referrals/word-of-mouth 


0.90 


— 




(high) price sensitivity 


— 


— 


— 


(reduced) service costs 




— 


0.82 


dependence 


loyalty 


0.79 


— 




continuation of relationship 


0.17 


-0.04 


WiIU 




0.14 


0.13 


Mi %bM 


referrals/word-of-mouth 


— 


0.66 


MEM 


(high) price sensitivity 


-0.23 


— 


■ESI 


(reduced) service costs 


- 


0.52 


0.52 



Table 2. Calculation of total effects of the behavioral consequences of high customer com- 
mitment in the online brokerage business 



4 Summary 



Customer commitment seems to be a relevant management goal in online broker- 
age since the tested models were able to explain commitment and its behavioral 
consequences. Beyond that, it was empirically verified that the distinction of two 
separate commitment dimensions is practically relevant to achieve customer be- 
haviors that positively influence a company's profits. Generally, loyalty has stron- 
ger effects on desired behaviors of online customers than dependence. Thus, on- 
line brokerage firms should focus on pursuing loyalty instead of "forcing" repeat 
usage based on exit barriers alone. However, as increased dependence positively 
influences a customer's loyalty, the development of a certain degree of dependence 
might effectively augment the loyalty strategy to support sustainable commitment 
levels of online brokerage users. To build up the desired customer "loyalty", 
online brokerage providers need to focus on developing trust-based, satisfactory 
and socially-rewarding business relationships with their profitable customers. 
Concrete marketing activities need to be analyzed based on segment-specific or 
individual preferences which goes beyond the scope of this paper. Additionally, 
the online broker should implement user profitability calculations as foundation 
for a priorization of customers and efficient allocation of scarce resources. 
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Abstract. Product bundling describes an interdisciplinary problem of great im- 
portance. It can be used to tailor offers to the demand of consumer segments (mar- 
keting), it helps to tackle variety reduction management issues (production), it is 
based on consumer preferences (data analysis), and it needs combinatorial opti- 
mization as solution tool (operations research). 

In this paper a new profit-maximizing mixed integer product bundling formulation 
is presented that works well for modest problem instances. Additionally, a heuristic 
approach is derived that copes with the situation in a Greedy-like manner for larger 
problem instances by providing a sequence of monotone increasing lower bounds 
for the objective function of our product bundling methodology. 

1 Introduction 

The joint offer of two or more different products or services that are sold 
at a unique price is referred to as bundling. It was first discussed in the 
early 1960 in a primary legal context with a main focus on monopolists that 
attempted to expand their monopoly power into other competitive markets 
by the use of bundling ([13]). By the time two basically different research 
streams emerged: A more behavioristic orientated group of authors explored 
perceptional aspects of bundling and associated consequences on consumer 
preferences ([17], [9], [3]), another direction of research focused essentially 
on the determination of optimal bundling and pricing strategies. Like the 
approach of [1], researchers as [10] or [11] provided a graphical framework 
that allowed for analyzing different bundling strategies where mostly additive 
structures of product preferences were assumed (e.g., [1], [12], [11]). Motiva- 
tions for bundling include exploitation of demand complementary, the already 
mentioned competitive effects, and the consideration of price discrimination. 
As a major advantage in terms of product variety many authors discussed 
the possibility of smoothing out consumer preferences as effect inherent in 
bundling . Some authors like [2] extended their work to situations where 
competition among firms is prevalent. However, little work has been done up 
to now concerning the development of usable decision models and appropri- 
ate algorithms for generating optimal bundles and prices, respectively. Main 
contributions in this area were given by the work of [6] and [16]. 

Since products can be often viewed as bundles of product characteristics 
([15]), product bundling received growing attention in new product develop- 
ment due to its ability to tackle the problem of increasing product variety 
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([4]). As in many cases firms produce a basic version of a certain product 
which is offered along with several optional features, product variety is mainly 
generated by mixing and matching those options ([14]). This is fairly common 
practice, e.g., in the automobile or computer industry. 

The remainder of this paper is structured as follows. Section 2 is intended 
to give an introduction into the fundamentals of a mathematical formulation 
for generating optimal bundles and prices, respectively. We discuss character- 
istics as described in the well-known Hanson, Martin paper ([6]) and explain 
possible problems that may arise when heuristic approaches are formulated. 
In section 3 a new model is proposed that enables a proper specification of 
a new heuristic approach and an example is presented to demonstrate its 
usefulness. Section 4 concludes the paper. 

2 Fundamentals of a Mathematical Formulation of 
Product Bundling 

2.1 Assumptions and Optimization Approach 

Some preliminary assumptions and notations are needed to establish an un- 
derlying framework for product bundling. Starting point is the set of prod- 
ucts J whose elements are also called components of the bundles to be cre- 
ated, Bi C J is the set of components contained in bundle /, L is the set of 
all possible bundles, and I is the set of segments of potential buyers (with 
i — 1, . . . , |/|, j = 1, . . . , | J|, and l = 1, . . . , \L\ = 2l J l — 1). Since each prod- 
uct by itself constitutes a bundle, we assume that the first \J\ bundles in 
L correspond to the respective products. The cost q of bundle l is the sum 
of costs of the products contained in the bundle, i.e. q = c r Bundle 

l can be offered to segment z at a price pu. Each segment i is character- 
ized by its size Ni and utilities or reservation prices ru for every possible 
bundle Z, i.e. utility is measured in monetary units via reservation prices. 1 
Given prices, reservation prices, and the composition of the bundles, every 
consumer of segment i wants to maximize her/his surplus. Consumer surplus 
can be described as the difference between reservation price and actual price 
of the bundle l: ru — pu- We assume that consumers cannot get any surplus 
if they don’t purchase anything and that the benefit obtained from multiple 
components is zero, because to avoid arbitrage we suppose that a resale of 
components is not possible. On the other side, we assume that there is free 
disposal of unwanted components. 

Furthermore, consumer choice is denoted by binary variables On G {0, 1} 
with 

0 _ J 1, if segment i buys bundle Z 
ll \ 0, otherwise. 

1 A reservation price can be interpreted as the maximal price a consumer is willing 
to pay for a bundle. 
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Additionally, we define indicator variables yp G {0, 1} where 



Vji = 



1, if jeBi 
0, otherwise 



which we will use in our new approach. 

Explicit price discrimination is excluded so that all customers face iden- 
tical prices for the same bundle (i.e. pu = pi,i G /, l G L). Despite the as- 
sumptions mentioned up to now we allow for combinations of bundles offered 
without any additional assembly costs. Without doubt the latter isn’t consis- 
tent with the general assumption within select-one-out-of-many modeling of 
consumer choice behavior in traditional marketing models and constitutes a 
main characteristic of bundling. This fact should therefore receive particular 
attention in the sequel. 

Definition 1. We call a price schedule subadditive if the following conditions 
hold: 

Pi < ^2 P k l ^ L->K £ {K\ &k = 

keK 

Under the above assumptions it can be shown that if a profit maximizing 
firm knows all relevant reservation prices of their potential customers, then 
there exists a subadditive price schedule which is optimal. As an immediate 
consequence one may conjecture that each consumer will purchase at most 
one of the bundles. A major drawback, however, is the fact that all possible 
bundles have to be considered explicitly. 

Due to page restrictions we use the following MHM (Modified Hanson, 



Martin [6]) formulation: 

MHM: max EE Ni(pu - ci6 a ) (1) 

iG/ l£L 

E ( r ii e ii - p ii) - max {°’ r u- Pi} ieI,leL (2) 

ieL 

Pi<Y.Pk leL,K€{K\ u- kef: B- k = Bt} (3) 

k€K 

Pu >Pi- M{ 1 - e ü ) ieI,l<zL (4) 

Pa < pi i el, l eL (5) 

^20u< 1 i e I (6) 

ieL 

VuVu > 0 ieI,leL ( 7 ) 

On £ {0? 1} i G /, l G L (8) 



where M is a sufficiently large constant. The constraints allow for the follow- 
ing interpretation: The inequalities in (3) enforce a subadditive price sched- 
ule (see also definition 1) and consumer choice behavior resembles a first 
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choice situation as given by constraint (2), i.e. each consumer will buy that 
bundle which provides the maximal surplus. Although the model allows for 
segment specific prices pu each segment that actually buys faces identical 
prices for identical bundles (because if a bundle l is selected (On = 1), (4) 
and (5) enforce pu = pi , otherwise (for On = 0) conditions (2) along with 
the nonnegativity of pu ensure pu = 0). Constraints (6), (7), and (8) are 
self-explaining. As a solution of MHM we get an optimal set of bundles 
L opt = {l € L | Yliei > 0} ^ a t should be offered together with an opti- 
mal price schedule. It is worth mentioning that \L opt \ < \I\ holds as each 
segment chooses at most one of the bundles. 



2.2 Price Subadditivity and Further Implications of MHM 

A crucial part of MHM is constituted by constraint (3) that describes and 
guarantees for the special structure of the solution. However, Gaul, Stauß [5] 
show that it suffices to examine price subadditivity in terms of restrictions 
for pairs of bundles only instead of those given by (3). 

Up to now no assumptions about the functional form of consumer prefer- 
ences were made. One can tackle this problem by supposing that reservation 
prices for all bundles are known. But the availability of such information 
seems to be somewhat unrealistic given the combinatorial variety induced 
even by a small number of components. Thus, as it is frequently done in the 
literature, we suppose that reservation prices are additive, i.e. ru = r tr 

Furthermore, this assumption enables the use of decompositional methods 
like conjoint analysis based on linear additive model specifications that pro- 
vide estimators for reservation prices (see ,e.g., [8], [7] for a discussion of the 
methodology in the context of product bundling). 

An essential drawback of MHM is given by the fact, that for optimization 
all possible bundles have to be listed explicitly. This is due to the necessity 
of checking price subadditivity in order to guarantee the appealing structure 
of the solution. 

In the next section a heuristic approach is formulated in which constraints 
(2) and (3) of MHM are replaced by restrictions that are easier to handle with 
respect to an incomplete enumeration of bundles. 

3 A New Model 

3.1 Problem Reformulation 

In a current paper of Gaul, Stauß [5] a new formulation of the bundling prob- 
lem is proposed. The underlying assumptions of the new model are similar 
to those that were given in section 2 with a slight but essential modification: 
price subadditivity has not to be postulated explicitly anymore so that a cru- 
cial obstacle in developing heuristic approaches is eliminated. On the other 
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hand the special structure of the solution induced by subadditive prices is 
still considered. 

^From now on we will refer to the already introduced indicator notation 
for bundles yß instead of the equivalent set representation Bi and replace 
constraints (2) and (3) by the following set of conditions: 



EKE r ijVjl -Pil 1 > E“« + E Vil + E r « i€l ( 0 ) 
\ J jG«/ ItzL j£J 

Y2 u nyß + v u > ~Pi iei,l eL (10) 

jej 

Uij ^ Tij Z G I , j G J (H) 

-Uij > 0 ielJeJ (12) 

vu 0 i G /, / G T (13) 



where and vu are additional variables. As is shown in [5] every optimal 
solution of MHM is also feasible in the new formulation NBM (New Bundling 
Model) described by the target function (1) together with constraints (4) - 
(13). 



3.2 Heuristic Approach 

For NBM the following heuristic approach is suggested. Starting from a given 
set of bundles L = {1, . . . ,m} (that could also be empty) bundle augmen- 
tation is performed successively. Augmentation step k with L := L U {k} 

uses fixed values yß, j G J, l = 1, k — 1, for the description of bundles 

determined so far and G {0, 1}, j G J, for finding the ‘optimal’ bundle 
k. Subsequently, the heuristic approach is solved for optimal prices and the 
bundle candidate k. If the target function (1) can be increased the new bun- 
dle {y^ , j G J) is added to the set L and the procedure iterates, otherwise 
the algorithm terminates. This heuristic approach generates a sequence of 
monotonic increasing lower bounds for (1). It should be noticed that nonlin- 
earities evolve from the introduction of the yjk • However, this is manageable 
without any difficulties since only one new bundle has to be generated in 
each step and standard linearization techniques in integer programming can 
be applied. A flowchart of the heuristic approach is given in Fig. 1. 



3.3 Example 

Suppose, a firm intends to bundle five products (j = 1, . . . , 5) and sell them 
to six segments (i = 1, . . . , 6) of equal size (we use Ni = 1, i G /). Segment- 
specific reservation prices and costs for the products are given in Table 1 
from which corresponding values for the bundles can easily be determined. 
As the complexity of such problems is mainly dependent on the number 
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Fig. 1. Heuristic Approach for NBM 



of segments considered, and the number of products used for bundling and 
results in considerable computational efforts even for this quite small prob- 
lem, we used the proposed greedy-like heuristic approach which starts from 
the empty set of bundles and successively generates at each iteration step 



r ij 



(i,j) 


j = i 
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3 


4 


5 


i — 1 


13 


15 


16 


17 


23 


i = 2 


14 


35 


17 


10 


21 


i = 3 


30 


25 
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10 


14 


i = 4 


23 


10 


23 


32 


19 
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13 


20 


14 


40 


12 
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32 
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27 
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Vz 


29 


10 


15 


10 


25 



Table 1. Problem parameter 
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Vji 
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= 2 l 


= 3 l 
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0 
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0 
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124 
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55 
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- 
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II 
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52 


55 
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- 
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74 


55 


52 


55 


130 


- 


153 


k = 6 


74 


55 


52 


55 


130 


60 


154 



Table 2. Solution tableau 



k a new bundle candidate , j G J, and bundle prices pf (l = 1, . . . , k). 
The solutions at each iteration are tracked by Table 2 that shows the bundle 
composition, respective prices and how the value of the target function (1) 
increases. 2 We further note that yji, j G J, the first candidate selected in the 
heuristic approach, has been priced out systematically in the course of the 
procedure which finally leads to the rejection of this bundle by all customers. 
Furthermore, segment 1 does not buy at all. It is worth noting that with the 
proposed bundling strategy a nearly complete skimming of consumer surplus 
is possible. Only segment i = 6 would get a positive surplus from the first 
bundle but this surplus is too low to keep it from switching to the bundle 
with the highest surplus. 3 

Computation time for each iteration of the heuristic approach was within 
a fraction of a second. 4 

A comparison of the heuristic results and the exact solution obtained via 
NBM showed that both solutions were identical, i.e., both solution methods 
provide the same set of bundles that should be introduced. In contrary, if 
bundling wouldn’t be taken into account an optimal pricing schedule for the 
product would leave the customers much more surplus resulting in a decrease 
of overall profit for the supplier of the - now - single products by 27%. 



2 One should mention that in cases in which different bundles would create the 
same surplus for a segment the heuristic approach selects that bundle with the 
highest profit for the bundle supplier. 

3 In the underlying problem bundle 2 and 5 yield the same surplus of 7 units, thus, 
the procedure decides for bundle 5 that generates the highest profit. 

4 The heuristic solution procedure has been implemented using Ilog’s Cplex solver. 
The solver was integrated in an overall Java routine via Ilog’s concert interface. 




228 



4 Conclusions 

In recent years product bundling has become a prevalent marketing practice. 
However, only a few approaches exist that deal with the determination of 
optimal bundling and pricing. Promising work was done by Hanson, Martin 
[6] . But a drawback of their approach is that it requires considerable compu- 
tational effort and that their mathematical modeling complicates the formu- 
lation of heuristic approaches. In this paper, a new approach was presented 
that allows the application of a simple greedy-like procedure. An example 
shows how easy it is to get good solutions. 
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Zusammenfassung Im vorliegenden Beitrag wird eine Methodik zur Bestimmung 
der ökonomischen und ökologischen Auswirkungen von betriebsübergreifenden 
Energieversorgungskonzepten entwickelt und deren Einsatz an einem Praxisbei- 
spiel aufgezeigt. Im Zentrum der Methodik steht ein gemischt-ganzzahliges Opti- 
mierungsmodell zur Identifikation der ausgabenminimalen Struktur der betriebs- 
übergreifenden Energieversorgung. Zur Ermittlung der dafür benötigten Parameter 
wird ein verfahrenstechnisches Prozesssimulationsmodell genutzt und in einer der 
Optimierung nachgeschalteten Analyse werden die anfallenden Kosten und Erlöse 
mit Hilfe spieltheoretischer Verfahren unter den Partnern aufgeteilt. 



1 Problemstellung und Zielsetzung 

Das Schließen von Stoff- und Energiekreisläufen bildet ein Leitmotiv für ein 
nachhaltigeres Wirtschaften. Wie Sterr [9] aufzeigt, stößt die industrielle Stoff- 
kreislaufwirtschaft auf Industriestandortebene allerdings schnell an ihre Grenzen, 
weil zumeist der passende Anbieter oder Interessent an einem bestimmten Stoff in 
der unmittelbaren räumlichen Nachbarschaft fehlt. Während es zur Realisierung 
stoffkreislaufwirtschaftlicher Potenziale demnach eines über den Industriestandort 
hinausgehenden Suchraums bedarf, implizieren die Verluste beim Wärmetransport 
die Forderung nach räumlicher Nähe bei der Kopplung von Energieströmen. Bis- 
lang werden Möglichkeiten des betriebsübergreifenden 1 Koppelns von Energie- 
strömen allerdings kaum systematisch analysiert, obwohl aufgrund der mit der Be- 
reitstellung und der Nutzung von Energieströmen verbundenen Emissionen hier 
noch beachtliche Potenziale zur Reduktion von Umweltbelastungen vermutet wer- 
den können. Besondere Relevanz erfährt der Energiebereich auch deshalb weil der 
durch die Deregulierung des Energiemarktes eingetretene Preiswettbewerb ökolo- 
gische Maßnahmen verstärkt in den Hintergrund gedrängt hat. 

Zielsetzung des vorliegenden Beitrages ist es daher, eine Methodik zur Be- 
stimmung der ökonomischen und ökologischen Auswirkungen betriebsübergrei- 



* Im Folgenden werden die Begriffe betriebsübergreifend und untemehmensübergreifend 
vereinfachend synonym verwendet. 
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fender Vernetzungsoptionen von Energieströmen unter den neuen Rahmenbedin- 
gungen des liberalisierten Energiemarktes vorzustellen. Des Weiteren soll der Ein- 
satz dieser Methodik an einem Praxisbeispiel aufgezeigt werden (vgl. auch [3]). 



2 Eine Methodik zur strategischen Planung 

betriebsübergreifender Energiemanagementkonzepte 

Die entwickelte mehrstufige Methode zur strategischen Planung betriebsübergrei- 
fender Energiemanagementkonzepte besteht aus den Elementen der technischen 
Analyse, der techno-ökonomischen Optimierung und der Aufteilung möglicher 
Einsparungen auf die Kooperationspartner. Die technische Analyse hat dabei die 
Ausarbeitung von konkreten, an die spezifischen Gegebenheiten angepassten An- 
lagenkonfigurationen als Ziel. Die so erarbeiteten techno-ökonomischen Parame- 
ter bilden Eingangsgrößen für die sich anschließende ökonomische Optimierung 
der Energiebereitstellung. Da ein - so identifiziertes - unternehmensübergreifendes 
Optimum aus der Sicht eines einzelnen Unternehmens allerdings eine suboptimale 
Lösung darstellen kann, bedarf es eines dritten Methodenbausteines zur Bestim- 
mung einer stabilen Kosten- bzw. Erlösaufteilung. 



2.1 Erster Schritt: Die verfahrenstechnische Prozesssimulation 

Um Energiebereitstellungsanlagen auf die spezifischen Rahmenbedingungen an- 
passen zu können, ist eine spezifische Anlagenauslegung erforderlich. Dabei ist 
insbesondere die Erfüllung der Energiebilanzen sowie thermodynamischer Gesetz- 
mäßigkeiten zu beachten. Aufgrund der damit verbundenen Komplexität bedarf es 
zur Bestimmung detaillierter Daten der Simulation der Energieanlagen, wozu die 
entwickelte Methodik auf das Flow-Sheeting-Simulations-Programm „Aspen 
Plus“ zurückgreift. Mit Hilfe dieses Simulationsprogrammes werden technische 
Prozesse in verschiedene unit operations aufgeteilt, bspw. in chemische Reaktio- 
nen oder thermische und mechanische Prozesse. Diese unit operations, die die 
Umwandlung vorgegebener Stoff- bzw. Wärmeströme (Input) in austretende 
Stoff- bzw. Wärmeströme (Output) beschreiben, werden durch physikalische und 
chemische Prozesse definiert, die auf thermodynamischen Gesetzmäßigkeiten be- 
ruhen. Flow-Sheeting-Simulations-Programme berechnen die Massen- und Ener- 
giebilanzen komplex verschalteter verfahrenstechnischer Systeme, basierend auf 
geeigneten thermodynamischen Modellen. Die Software „Aspen Plus“ verwendet 
zur Lösung der Massen- und Energiebilanzen der komplex verschachtelten unit 
operations einen sequentiell modularen Lösungsansatz [1]. 

Der Vorteil einer solchen verfahrenstechnischen Modellierung liegt darin, dass 
hierdurch eine adäquate Abbildung der technischen Prozesse erreichbar ist bei 
gleichzeitig hinreichender Flexibilität hinsichtlich der zu variierenden Betriebs- 
und Prozessparameter. Dadurch kann die optimale Anpassung neuer Anlagen wie 
bspw. betriebsübergreifender Kraft- Wärme-Kopplungsanlagen an die lokalen Ge- 
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gebenheiten erreicht werden. Die so erhaltenen technischen Auslegungsgrößen 
stellen die Grundlage für die Bestimmung der ökonomischen Größen dar. 



2.2 Zweiter Schritt: Ein Modell zur Identifikation der 
ausgabenminimalen Energieversorgungsstruktur 

Die mit Hilfe der Aktivitätsanalyse [7] mögliche Abbildung von Pro- 
duktionssystemen mit linearen Input-Output-Beziehungen über einen konstanten 
Wirkungsgrad und lineare Substitutionsmöglichkeiten bildet die Grundlage für die 
Technologieabbildung im entwickelten Modell. Mit der Einführung von ökono- 
mischen Größen und Restriktionen wird ein gemischt-ganzzahliges lineares Opti- 
mierungsproblem zur systematischen Analyse von (betriebsübergreifenden) Ener- 
giemanagementkonzepten formuliert. Das entwickelte Modell PERSEUS-IFC 
(Program Package for Emission Reduction Strategies in Energy Use and Supply - 
Inter-Firm Concepts) bildet die energetischen Strukturen der beteiligten Unter- 
nehmen detailliert nach. Im Modell werden dazu sowohl existierende Energiean- 
lagen der Unternehmen als auch zukünftige Investitionsalternativen u. a. zur Ver- 
netzung der Energieflüsse anhand techno-ökonomischer Parameter beschrieben. 
Die Energieanlagen sind durch Energie- und Stoffflüsse sowie über Transport- 
und Verteilungsanlagen miteinander verknüpft. Ziel des Modells ist es, den ausga- 
benminimalen Weg zu identifizieren, um die in den Unternehmen benötigten E- 
nergieformen bereitzustellen. Die Zielfunktion der Ausgabenminimierung ent- 
spricht den realen Gegebenheiten in Industrieunternehmen, da hier die Priorität 
der eigentlichen Produktionsprozesse zur Konsequenz hat, dass für die Energie- 
versorgung stets das ökonomische Prinzip in seiner Minimumversion gilt. 

Des Weiteren wird im Modell eine Vielzahl energiewirtschaftlicher Besonder- 
heiten berücksichtigt, bspw. dass die beim Ausfall eines Kessels wegfallende Leis- 
tung kleiner gleich der Summe der restlichen zur Verfügung stehenden Warmre- 
serven und des kontrolliert möglichen Lastabwurfs sein muss. Auf der energe- 
tischen Nachfrageseite wird für alle Prozesse der zeitliche Verlauf des Energie- 
bedarfs der Produktionsanlagen mit Hilfe von Lastganglinien approximiert. Dabei 
werden die Jahre des Betrachtungszeitraumes durch charakteristische Tage reprä- 
sentiert, die in mehrere Zeitintervalle unterteilt sind. Das Modell ist in der Pro- 
grammiersprache GAMS [2] modelliert und benutzt ein auf Microsoft Access ba- 
sierendes Datenmanagementsystem [5]. Das Planungsproblem lässt sich 
folgendermaßen formulieren: 

Minimiere 
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WRES uXseas = ( Cpo ul + Z u yCapn u )- 



Pu 



- HV„ 



u,l,seas 



V m eU;\/t eT; \/seas e S (8) 

+ 2«,, • c«p«„ = 

\/ueU;\/t eT; \fseas e S (9) 
PL P ,t,seas e i + \fpeP; \fseas eS;\/teT (10) 

Xi p,fj,seas . Xo p,f,t,seas e i + Vf eF;\/peP; Vseas eS;VteT (11) 

Z H( e0 + VueU;VteT (12) 

i * VueU-ytET-.VseaseS (13) 



Die zu analysierenden Energiesysteme der beteiligten Unternehmen bestehen 
aus einer Menge U={l,...,m} existierender Anlagen und zukünftiger Zubauoptio- 
nen. Jeder dieser Anlagen ueU ist mindestens ein technischer Prozess peP 
(P={ l,...,n}) zugeordnet, mit dessen Hilfe die Fahrweise der Anlage nachgebildet 
wird. Diese Prozesse repräsentieren somit den Transformationsprozess des einge- 
henden zum ausgehenden Energieträger feF (F={ l,...,r}). Im Modell wird der ge- 
samte Planungshorizont in einzelne Perioden teT (T={0,...,w}) unterteilt, wobei 
jede dieser Perioden zur Nachbildung der Energienachfrage mit Hilfe von Last- 
kurven an charakteristischen Tagen in Zeitintervalle seaseS (S={0,...,x}) unter- 
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gliedert wird. Die Zielfunktion des Modells (1) liegt in der Minimierung der 
Summe der diskontierten Ausgaben. Dazu sind den Variablen für die Aktivitätsni- 
veaus (PLp t?S eas) und für die in einen Energiewandlungsprozess ein- (Xi P5 f ?5t?sea s) und 
ausgehenden Energieflüsse (XOp 5 f„t,seas) Ausgabenkoeffizienten zugeordnet, welche 
die variablen Ausgaben (Cvar p ^ Ueas und Cvp Ueas ) charakterisieren. Fixe Ausga- 
benbestandteile (Cfix u>t ) und die spezifischen annuisierten Investitionen des Kapa- 
zitätszuwachses (Cinv u?t ) sind den Kapazitätsvariablen (Z u?t ) zugeordnet. Die Glei- 
chungen (2) bestimmen mit Hilfe der Restnutzungsdauer rest u?U ' die Anzahl an 
neuen Anlagen ueU, die im Planungszeitraum installiert wurden und in der Perio- 
de t noch immer verfügbar sind. Durch die Kapazitätsungleichungen (3) wird si- 
chergestellt, dass in jedem Zeitintervall seas (z. B. Sommerwerktag 8.00 - 10.00 
Uhr) jeder Periode t ausreichend Kapazität (bereits vor dem Betrachtungshorizont 
installierte Kapazität (Cpo u?t ) plus die Anzahl Z u t an neuen Blöcken (Capn u )) zur 
Verfügung steht, um die gewählten Aktivitätsniveaus PL p?t5Seas bezogen auf die In- 
tervalllänge h seas erbringen zu können. Mit Hilfe der Nebenbedingungen (4) wird 
der Input in einen Prozess mit dessen Aktivitätsniveau gekoppelt, wobei der pro- 
zessspezifische Wirkungsgrad r| p t und der Inputanteil des Prozesses in ftP berück- 
sichtigt werden. Die Verbindung der Energie- und Stoffflüsse zum Output der ein- 
zelnen Technologien wird unter Berücksichtigung des Outputanteils des Prozesses 
(outf ?p ) über die Gleichungen (5) realisiert. Schließlich garantieren die Nebenbe- 
dingungen (6), dass die Energienachfrage D f?Ueas durch entsprechende Flüsse an 
Energieträgern f in jedem Zeitintervall seas der verschiedenen Perioden t gedeckt 
wird. Die Ungleichungen (7) stellen für jedes Zeitintervall seas der verschiedenen 
Perioden t sicher, dass die beim Ausfall eines Kessels wegfallende Leistung klei- 
ner gleich der Summe der restlichen zur Verfügung stehenden Warmreserve 
WRES Ujt ,seas und des kontrolliert möglichen Lastabwurfs LAbw ist. Die Warmre- 
serve berechnet sich nach den Gleichungen (8) anhand der Differenz aus der vor- 
handenen Leistung und der im konkreten Zeitpunkt genutzten Leistung. Hierbei 
muss allerdings berücksichtigt werden, dass die Warmreserve gleich null ist, wenn 
die Anlage in diesem Zeitpunkt nicht betrieben wird. Hierzu wird in die Gleichun- 
gen (8) die Hilfsvariable HV u?t , se as eingeführt, die genau dann den Wert der instal- 
lierten Kapazität haben muss, wenn die Anlage nicht läuft. In den Gleichungen (9) 
wird hierfür der Summe der Hilfsvariablen HV U)tfSeas und HP u t seas der Wert der in- 
stallierten Kapazität zugewiesen. Auf die des Weiteren benötigten Gleichungen, 
die unter Rückgriff auf binäre Variable dafür sorgen, dass entweder HV u?t seas oder 
HP u ,t,seas einen positiven Wert haben, keinesfalls aber beide, sei hier aus Platzgrün- 
den verzichtet (siehe hierfür [4]). 



2.3 Dritter Schritt: Die nachgeschaltete spieltheoretische Analyse 

Falls die identifizierte Optimallösung eine unternehmensübergreifende Lösung 
darstellt, müssen die Kosten und / oder Erlöse auf die möglichen Kooperations- 
partner aufgeteilt werden. Insbesondere kann das identifizierte betriebsübergrei- 
fende Optimum zu Lösungen führen, die aus der Sicht eines einzelnen Unterneh- 
mens eine suboptimale Situation oder gar eine Verschlechterung gegenüber der 
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Ausgangssituation darstellen. Ein Kooperationsvorhaben ist aber nur dann lang- 
fristig stabil, wenn alle beteiligten Unternehmen die Rahmenbedingungen und die 
Ausgestaltung des Vorhabens akzeptieren. Demzufolge darf keines der beteiligten 
Unternehmen einen Anreiz besitzen, aus der Kooperation auszuscheren, um sich 
eventuell im Alleingang oder mit anderen Unternehmen besser zu stellen. Zur Lö- 
sung der Allokationsproblematik können die in der BWL existierenden „klassi- 
schen“ Verfahren wie Restwert- und Verteilungsrechnung angewendet werden. 
Um anreizkompatible und langfristig stabile Aufteilungsschlüssel zu entwickeln, 
sollte alternativ auf Ansätze der kooperativen Spieltheorie zurückgegriffen werden 
[6]. Hierzu werden im Folgenden vier Konzepte eingesetzt: Den Kern als Vertreter 
der Mengenkonzepte sowie den Nucleolus, den Shapley-Wert und die Alternate 
Cost Avoided Method als Vertreter der Wertkonzepte. 



3 Anwendung der entwickelten Methodik zur Analyse 
betriebsübergreifender Energiemanagementkonzepte 

Die entwickelte Methodik ist im Rahmen eines BMBF-Projektes zur Entwicklung 
betriebsübergreifender Energieversorgungskonzepte für drei energieintensive In- 
dustrieunternehmen [1,2,3] aus Karlsruhe sowie die dort ansässigen Stadtwerke 
angewandt worden. Die an dieser Fallstudie beteiligten Unternehmen sind dicht 
beieinander in der Nähe des Karlsruher Rheinhafens angesiedelt. 

Im ersten Schritt der dreistufigen Methodik wurden unter Einsatz des Flow- 
Sheeting-Simulations-Programms „Aspen Plus“ verschiedene Energiebereitstel- 
lungsanlagen ausgelegt. Beispielsweise wurde eine Gas und Dampfturbinen- 
Anlage (GuD- Anlage- [1,2, 3]) zur gemeinsamen Versorgung der drei Unterneh- 
men mit Strom und Dampf konzipiert. Dabei handelt es sich um eine rauchgassei- 
tig dreisträngige Anlage mit drei Gasturbinen sowie drei nachgeschalteten, zusatz- 
befeuerten Abhitzekesseln und einer Gegendruck-Dampfturbine mit Mittel- und 
Niederdruckdampfauskopplung. Als wesentliche Kenngrößen der Anlage ist eine 
elektrische Gesamtleistung von 260 MW sowie ein Gesamtwirkungsgrad von ca. 
89 % errechnet worden. Die Investitionsschätzung mit Hilfe detaillierter Zu- 
schlagsfaktoren für die Nebenpositionen ergab ca. 198 Mio. €, was einer spezi- 
fischen Investition von ca. 760 €/kW e i entspricht. Analog erfolgte die techno-öko- 
nomische Charakterisierung sowohl von weiteren betriebsübergreifenden Energie- 
managementkonzepten (wie bspw. die Nutzung von Abwärme des Unternehmens 
1 in Unternehmen 2) als auch von Investitionsalternativen zur getrennten Energie- 
versorgung bei den beteiligten Unternehmen. 

Für die Berechnungen mit Hilfe des PERSEUS-Modells bedarf es des Weiteren 
gewisser Annahmen hinsichtlich der ökonomischen Rahmenbedingungen. Dazu 
sind die Energieträgerpreise entsprechend einer Prognose von Prognos [8] ange- 
setzt worden, wobei unterstellt wird, dass die Energieträgerpreise für alle Unter- 
nehmen gleich sind, wenn sie die selbe Abnahmestruktur besitzen. Zudem wird 
für Strom aus Kraft- Wärme-Kopplungsanlagen (KWK- Anlagen), der in ein 
Stromnetz der öffentlichen Versorgung eingespeist wird, die Zahlung einer Ein- 
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Speisevergütung durch den Netzbetreiber modelliert, die sich aus einem zwischen 
dem KWK-Anlagenbetreiber und dem Netzbetreiber zu vereinbarenden Strom- 
preis und einem gesetzlich festgelegten Zuschlag zusammensetzt. Schließlich ist 
die Nachfrageentwicklung in den Unternehmen als konstant angesetzt worden. 

Das sich so ergebende Optimierungsproblem besteht aus rund 40.000 konti- 
nuierlichen und ca. 3.000 ganzzahligen Variablen, rund 32.000 (Un-)Gleichungen 
mit etwa 140.000 Nicht-Null-Elementen. Bei Verwendung eines Rechners mit In- 
tel Pentium III mit 900 MHz Taktfrequenz und einem Arbeitsspeicher von 768 
MB können sich Rechenzeiten von bis zu einigen Stunden ergeben, wobei zur Lö- 
sung des gemischt-ganzzahligen Optimierproblems der kommerziell verfügbare 
Solver CPLEX 7.0 eingesetzt worden ist. 

Die Analysen mit dem PERSEUS-IFC Modell zeigen, dass unter den getroffe- 
nen Rahmenbedingungen die dreisträngige GuD-Anlage-[l,2,3] die ausgabenmini- 
male Option zur Befriedigung der Energienachfragen in den beteiligten Unter- 
nehmen darstellt. Gegenüber der Referenzentwicklung ohne Zubau können so in 
den Jahren mit einer KWK-Förderung (d. h. bis 2010) die jährlichen Energiever- 
sorgungskosten um ca. 36,1 Mio. €/a reduziert werden; nach dem Auslaufen der 
KWK-Förderung ist noch eine jährliche Kostenreduzierung von bis ca. 15 Mio. 
€/a möglich. Hinsichtlich der Anlageneinlastung zeigen die Modellergebnisse, 
dass die GuD-Anlage-[l,2,3] nahezu im Grundlastbetrieb eingesetzt wird, um 
Strom und Prozesswärme zu erzeugen. Auftretende Lastspitzen werden mit den in 
den Unternehmen weiterhin vorhandenen Kesseln und Turbinen abgefahren. Die 
Bilanzierung der ökologischen Effekte verdeutlicht, dass die Errichtung der GuD- 
Anlage-[1,2,3] zu einer Minderung sowohl des Primärenergieverbrauchs als auch 
der betrachteten Emissionen in einer Höhe von ca. 30 % gegenüber der Referenz- 
entwicklung führt. Diese Ergebnisse stützen die Forschungshypothese, dass durch 
betriebsübergreifende Energiebereitstellungskonzepte ökonomische und ökologi- 
sche Verbesserungen simultan erzielt werden können. 

Um die Realisierung der GuD-Anlage zu ermöglichen, bedarf es allerdings 
noch der Aufteilung der möglichen Einsparungen auf die beteiligten Unterneh- 
men. In Abb. 1 werden die Ergebnisse der aus der Anwendung des „klassischen“ 
Restwertverfahrens und der spieltheoretischen Wertkonzepte resultierenden Ge- 
winnaufteilungen dargestellt. Es zeigt sich, dass die aus den spieltheoretischen 
Ansätzen resultierenden Gewinnaufteilungen eher in der Mitte des Kernlösungs- 
raumes liegen als die Aufteilung nach dem Restwertverfahren. Vergleicht man die 
spieltheoretischen Ansätze untereinander, so fällt auf, dass die Konzepte des Nuc- 
leolus und der ACA-Methode zu einem recht ähnlichen Ergebnis führen. Dagegen 
werden bei der Ermittlung der Shapley-Werte (Spieler 1: 14,2 Mio. €/a; Spieler 2: 
15,3 Mio. €/a; Spieler 3: 6,6 Mio. €/a) verglichen mit den beiden anderen Verfah- 
ren die Unternehmen 1 und 2 auf Kosten des Unternehmens 3 besser gestellt. Hier 
wirkt sich die Tatsache aus, dass Spieler 3 keine Unterkoalitionen bilden kann und 
somit die gewichtete Summe seiner Grenzbeiträge kleiner ist als die der Spieler 1 
und 2. Aufgrund der Eigenschaft der Konvexität des vorliegenden Spiels ist si- 
chergestellt, dass die Shapley-Lösung eine stabile Gewinnverteilung erzeugt. Bei 
dieser Ausgangslage ist die Shapley-Lösung den anderen untersuchten spieltheore- 
tischen Verfahren vorzuziehen, da sie dann alle wünschenswerten Eigenschaften 
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(wie Kernzugehörigkeit, Eindeutigkeit, Stabilität, Dummy, strenge Monotonie, 
Kovarianz, Monotonie im Aggregat, Koalitionsmonotonie, Effizienz, Symmetrie 
und Additivität [10]) aufweist. 




Abb.l: Simplex zur Darstellung möglicher Gewinnaufteilungen (Werte in Mio. €/a) 
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Zusammenfassung Die Altersstruktur einer Bevölkerung beeinflusst die Emp- 
fänglichkeit für Infektionskrankheiten sowie für chronisch-degenerative Erkran- 
kungen. Mit Hilfe eines System Dynamics Modells wird der epidemiologische 
Übergang von Infektionskrankheiten zu chronisch-degenerativen Erkrankungen 
simuliert, so dass die Auswirkungen verschiedener Parameter (medizinischer Fort- 
schritt, Alterung etc.) analysiert werden können. 



1. Introduction 

The age structure of a population is the key for the efficient allocation of health 
care resources. The population of developing countries is young and mainly suf- 
fers from infectious diseases, whereas industrialised countries are facing severe 
problems of an aging population with many chronic-degenerative diseases. These 
different diseases call for dissimilar health care systems and for diverse allocation 
schemes of health care resources. However, disparities are not only characterising 
the entire world, but even inside one country subpopulations might live in totally 
different situations. Rural areas of developing countries are commonly populated 
by many children and women, whereas towns are often the habitat of adult men 
with completely different diseases. Thus, we are living in many worlds of health - 
differences which we have to understand in order to make informed health care 
decisions. 

Figure 1 exhibits the model of the so-called demographic transition [1,2,3]. Du- 
ring phase I, the high fertility equals the high mortality, thus there is hardly any 
population growth. During phase II, the mortality begins to decrease whereas the 
fertility remains almost unchanged. In some countries fertility even begins to inc- 
rease. There is a multiplication of the population. The reason for the decreasing 
mortality can be better hygiene and sanitation or medical progress. The resulting 
population growth can only continue if additional economic resources for the inc- 
reased number of people can be provided. This was the case during the European 
industrial revolution which is frequently seen as a pre-requisite for this phase. Du- 
ring phase III, the mortality continues to decline whereas the fertility is declining 
as well. Thus, the population density is still increasing. There are various reasons 
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for the decline in fertility, such as urbanisation, social insurance, changes of cultu- 
ral values. Finally, in phase IV fertility and mortality have come down to a very 
low level of about 1-1.5 % and equal each other. Thus, there is no more population 
increase and in some countries fertility is below replacement reproduction. This is 
the situation in most western countries. It is assumed that the process of transition 
(beginning of phase II to end of phase III) takes about 80 years. 

The demographic transition is accompanied by a change in disease pattern. In- 
fectious diseases dominate in most countries in the first and second phase of the 
demographic transition, whereas chronic-degenerative illness is the major cause of 
morbidity and mortality in developed countries. Although this concept is well 
known, there have been hardly any attempts to quantify the impact of basic deter- 
minants of the demographic transition on the pattern of diseases, although this 
would be an excellent basis for strategic health care plans. Consequently, a multi- 
compartment system dynamics model was developed which allows to analyze the 
epidemiological transition. 




2. Model 



The population of a pattern country is structured in 320 compartments according 
to age (80 age-sets of each one year) and health status (healthy, infectious dis- 
eased, chronic diseased, multi-morbid), i.e. 

fl : healthy 



B Uj : population of age i in condition j with i = 0,..,79 [years] ; j = 



2 

3 

4 



: infectious diseased 
: chronic diseased 
: multi - morbid 



It is assumed that 50 % of each compartment are male, 50 % female. The simu- 
lation follows fixed time intervals of one day steps. The standard simulation is 120 
years, thus: d := 1..365 [days/year] , t := 1..120 [years]. 

It is assumed that the crude birth rate is merely a given function of time in the 
demographic transition, i.e. the determinants of the fertility rate are not conside- 
red. The crude birth rate is given as: 
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/ = 



f -begin 

f_begin - i l^iZ L rl^) 

(end _ fertil _ trans - begin _ f er til _ trans) 

f _ end 



for 0 < t < begin_fertil_trans 

for begin_fertil_trans < t < end_fertil_trans 

for t > end_fertil_trans 



with 

f _ begin fertility in t := 0 

/ _ end fertility in t := end_fertil_trans 

begin Jertiljtrans begin of fertility transition 
endjertiljrans end of fertility transition 
t time 

It is assumed that all children are born healthy, i.e. without infectious and/or chro- 
nic diseases. The crude birth rate (0 is a result of the age-specific fertility rates (fj) 
with 



A B U1 = 



GEB, 

0 



for i = 0 and j = 1 
otherwise 



GEB t =Y^^*fi* B uj 

i = 0 j= 1 

with 



/,= 



'#*(*-13) 

fi'i -#*('“ 29 ) 



0 



for 14 < i < 28 
for 29 <i< 43 
otherwise 



with 



i5*/*I2X, 

i=0 ;= 1 



f = 2 * 

J 29 ^ 28 4 43 4 28 4 

I*‘*I B,.j - £ f * 2 fi|, y - 13 * £ £ 

1=14 ^‘ =1 /=29 j =l i=14 > =1 




The simulation of the morbidity distinguishes infectious and chronic diseases. 
The immunity against infectious diseases shall depend on the age. 



I _ inf j 



I _ inf_ max ; * l / 25 for 0 < i < 25 

/_inf_max. for 25<i<50 

I inf max,.*| 1-- — — | for 50<i<79 with 
. ” " 7 l 30 J 



I _ inf ; 
7_inf_max ; 

/ _inf_max y 



: Immunity against infectious diseases in age i and health status j 
: Maximum immunity against infectious diseases in health status j 
0.9 for j = 1 
1.0 forj = 2 
* 0.7 for j = 3 
1.0 for j = 4 



The susceptibility is the contra-event of the immunity, thus: 
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fl-/ inf,, for je {1,3} 

E inf, , = \ ~ ‘■ J J ' with 

“ J [ 0 for je {2,4} 

E _ inf . j : Susceptibility for infectious diseases in age i and health status j 

For chronic diseases the susceptibility is a monotonous function of age. 

for 0 < i < 35 






0.2* E_C_tmXj*/ 35 



MS). 



0.2 *E C max,+— — —*0.6 *E C max, for35<i<60 
~ ' 25 - - 1 



(i- 60) a 



E - C >, 

E C max , 



0.8 *E C max,+- — — *0.2*£ C max, for 60<i<79 with 
" ~ ; 30 - - / 

: Susceptibility for chronic diseases in age i and health status j 
: Maximum susceptibility for chronic diseases in health status j 
0. 1 for j < 2 



E C max . = , 

~ “ ; [0.0 for j > 3 



A certain percentage of infectious diseases is prohibited by an increasing stan- 
dard of general hygiene. The hygiene standard shall be a function of time, i.e. 
fo for t < hygiene_begin 



h = 



h max* - 



t - hygiene _ begin 



for hygiene_begin < t < hygiene_end with 



hygiene _ end - hygiene _ begin 

[h_max for t > hygiene_end 

h t : hygiene standard in t 

hygiene_begin : first year of increasing hygiene standards 
hygiene_end : year where hygiene standard reaches its maximum 

h_ max : maximium hygiene standard 

Infectious and chronic diseases are leading to morbidity according to: 



0,.s = «.1 * 



. 1=0 4 



- * E _ inf ( . j * (1 -h t )*V 



/= 0 j=l 

D it3 - B tl *E _ Cj j *V _C 




241 



79 

T( B ,,2 +B J 

D iA = 5„ * £_inf, 3 * (1 -h,)*V + B i2 *E_ C„ 2 * V _ C 

IIX, 

i=0 j = 1 

with 

Dj 2 : Number of new infectious diseased without chronic diseases in age i 

D i 3 : Number of new chronic diseased without infectious diseases in age i 

D. 4 : Number of new multi - morbid diseased in age i 

V : Virulence and contact frequency, calibration variable for infectious diseases 

V _ C : Calibration variable for chronic diseases 



The compartments are adjusted accordingly at the end of each simulation inter- 
val. Diseased are recovering from their diseases according to: 



R 



R 



= 



C,J = 



R- inf,, 

R_Ci,j 

d inf, 



B * 1 

U i,j d _inf ; 

0 



B * — L — 

d_chrj 

0 



for j 6 {2,4} 
otherwise 
for j 6 {3,4} 
otherwise 



with 



: Recovery from infectious diseases in age i and heath status j 
: Recovery from chronic diseases in age i and heath status j 
: average length of infectious disease in health status j 



d_chrj : average length of chronic disease in health status j 
The compartments are adjusted accordingly. 

Three causes of mortality are introduced: mortality due to infectious diseases, 
mortality due to chronic diseases and "rest mortality" in the compartment of age 
79. The number of death cases due to the two first reasons is given as: 



T- inf,, 



m. 

B * J — 

l,J d inf 






m , 

T C -B * J - — *(1 -p t ) 

~ ^ d_ch rj K Pt) 

T t =T_ inf , 2 + T _ inf , 4 + T _ C, 3 + T _ C, 4 

with 



: death cases in age i 

T_infj j : death cases due to infectious diseases in age i and health status j 

T_C i j : death cases due to chronic diseases in age i and health status j 

nij : probability to die during the period of disease 

p t : medical progress in t, feasibility of preventing lethal consequences of diseases, with 
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fo 



for t < begin_med 



Pt = 



(t -begin _ med) 



p_msix 

(end _ med - begin _ med) 



for begin_med < t < end_med 



[p_ max for end_med < t 

begin_med : begin of medical progress 
end_med : year where medical progress reaches the maximum 
p_max : maximum medical progress 



The compartments are adjusted accordingly. 

The following results are calculated for each year of the simulation: Age dist- 
ribution, total population, percent of population <15 years, average age, age- 
specific mortality rates, life expectancy , percentage of health status 1-4, relation 
between health status 2:3, prevalence and incidence, death cases due to age, infec- 
tion, chronic, multi-morbid, under-five-mortality. 



3. Results 

The standard simulation assumes the parameters as shown in table 1. The basic re- 
sults are demonstrated in Figures 2 and 3. It is obvious that the health status of the 
population is a function of time in the demographic transition. About 77.15 % of 
the population are on average healthy in the first phase of the transition. About 
14.20 % of the population are suffering from infectious diseases and 7.60 % from 
chronic diseases. The rate of multi-morbid diseased (1.05 %) is rather low. The 
high number of children with an intense susceptibility for infectious diseases leads 
to a high infant morbidity. The general health improves during the demographic 
transition until it reaches its maximum at 84.5 % at t=73, i.e. the highest percenta- 
ge of the population is healthy just before mortality and fertility are reaching the 
fourth phase of the transition. Now a decline starts due to the steadily increasing 
prevalence of chronic diseases. Finally the population is less healthy (72.32 % in 
t=120) than at the beginning of the epidemiological transition. This deterioration 
of health is due to the increasing age of the population which leads in the begin- 
ning to a higher likelihood of developing chronic diseases. The older the populati- 
on gets, the more likely infectious diseases will fight their way back to society as 
very old people are again more susceptible to infectious diseases. 

Comparing the percentages of the population suffering from infectious diseases 
with the share of the population suffering from chronic diseases points at the core 
of the epidemiological transition: The importance of infectious diseases is getting 
less whereas the chronic diseases are steadily increasing. In phase I about 14.20 % 
of the population are sick due to infectious diseases, 7.60 % due to chronic disea- 
ses. At the beginning of the demographic transition (t>20) infectious diseases are 
still more significant, but their contribution to the general prevalence of diseases is 
getting less whereas chronic diseases are getting more. At t=49 the two curves are 
intercepting with 9.02 %. Afterwards the share of chronic diseases is increasing 
and the share of infectious diseases decreasing. 
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First year of fertility decrease 60 

Fertility in first year 5 % 

Fertility at the end of fertility decrease 1 % 

First year of hygiene change 20 

Last year of hygiene change 100 

Maximum share of infectious diseases prevented by hygiene 40 % 

First year of medical progress 20 

Last year of medical progress 100 

Maximum mortality reduction by medical progress 47 % 

Tab. 1: Parameter 
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Fig. 2: Prevalence and incidence of infectious and chronic diseases 



This result is underlined by Figure 2 which exhibits the prevalence and inci- 
dence of chronic and infectious diseases. Here, the prevalence is the relation bet- 
ween the days of sickness due to infectious and chronic diseases. The ratio is 
65.15 % to 34.85 % in the beginning of the transition. The shares are equal at t=49 
and find their maximum distance after the end of the transition (t=105) with 
5.38 % to 94.62 %. The incidence is the number of new cases not weighted with 
the length of sickness. As chronic diseases are usually having a longer period of 
sickness than infectious diseases, the incidence of chronic diseases compared with 
the incidence of infectious diseases is less at the beginning of the transition (92.45 
% infectious to 7.55 % chronic). The pattern of decreasing importance of infecti- 
ous diseases and increasing importance of chronic diseases is repeated, but the in- 
tercept occurs later (t=87). This is again due to the fact that patients suffer longer 
from chronic diseases and therefore a high prevalence is correlated with a low in- 
cidence. 

The simulations point at an interesting and surprising result: At the end of the 
simulation period the pattern of the epidemiological transition changes: the share 
of chronic diseases compared with infectious diseases is decreasing. In other 
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words: The infections are coming back. This is most likely due to the fact that ve- 
ry old people are more susceptible to infections. Therefore, an aged society is a 
multi-morbid society with many old people suffering from chronic diseases, others 
suffering from infections due to their limited immunity, and some are tortured by 
infectious and chronic diseases at the same time. Whereas the share of people suf- 
fering from multi-morbid diseases is merely 0.48 % in t=80, it is increasing to 
1.09 % in t=120. Thus, the aged-society is constituting a severe burden to the eco- 
no mic development of a nation. 
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Fig. 3: Mortality: infectious and non-infectious causes 

Figure 3 compares the mortality due to infectious and non-infectious (chronic 
and rest-mortality) diseases. Again we realise that in the beginning 92.07 % of the 
death cases is due to infections, whereas after 77 years the shares are equal. At 
t=l 10 the mortality due to infectious diseases is reaching a minimum, afterwards it 
is going to increase again to 24.08 % in t=120. This can be explained in the same 
way as the increasing morbidity of infectious disease illustrated above. 

It becomes obvious that the epidemiological transition is completely reversing 
the health situation of a country. The different shares of infectious and chronic di- 
seases call for different answers to health care problems and stress the fact that we 
do not only face different worlds of health status, but also different worlds of 
health care systems appropriate for different phases of the epidemiological transi- 
tion. At the same time the data presented above indicates that there is a strong 
need to analyse the impact of some variables on the epidemiological transition in 
more details, i.e. the fertility, the sanitation standard and the medical progress. 
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Abstract. In this paper we study a special class of bond portfolio management 
problems where strategic and operational as well as active and passive aspects are 
considered. On a strategic level a so-called reference portfolio is specified which is 
valid for a specific product class of bond funds (the class of Eurobond-funds for 
instance) for a specific period of time. On an operational level this pre-defined 
mix of assets has to be adapted by the fund managers as precisely as possible for 
each individual fund on a daily basis respecting all the investment guidelines which 
have to be fulfilled. Additional lot-size constraints, bid-ask-spreads and commission 
fees influence the cost of fund restructuring and the associated decision problem 
leads to a (high-dimensional) discrete non-linear program. We give an outline of a 
heuristic approach which we have applied in an ongoing decision support system 
(DSS) development project for a top-european private bank. 



1 Introduction 

The basic idea of portfolio optimization consists of selecting a subset of as- 
sets from an investment universe i.e. an usually very large set of available 
assets (stocks, bonds etc.) with respect to a given objective representing per- 
formance while respecting certain constraints stemming from the budget and 
from so-called investment guidelines. For the first time this problem was for- 
mally modeled by Markowitz (cf. [1]). 

While there is a vast number of publications on stock portfolio optimiza- 
tion only few literature exists on bond portfolio optimization models. In this 
paper we focus on an application of bond portfolio optimization which in- 
volves several specific features which are not present in pure stock optimiza- 
tion models as for instance different criteria like the duration etc. 

In the application which is the basis of our research we are confronted 
with a non-homogeneous investment universe, i.e. we distinguish nine dif- 
ferent types of bond investments, the called segments : government bonds, 
states/regions, jumbos/mortgage bonds, industrial bonds, Eurobonds of the 
convergence countries, subordinated debts, asset backed securities and cash. 
For this reason we cannot apply an evaluation and optimization model which 
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is designed for only a specific segment but we have to incorporate criteria 
which are valid for bonds in common. 

One main component of any model is the set of investment guidelines. 
Here we have developed a formal categorization which is the driver for our 
heuristic approach. In addition to these guidelines, lot-size constraints have 
to be observed, and bid- ask-spreads and commission fees influence the cost of 
fund restructuring. Altogether, this framework leads to a (high-dimensional) 
discrete non-linear program. 

2 The Investment Process 

The funds of the investment trust company are grouped into several different 
product classes as for instance the class Eurobond- funds etc. In the following 
we describe the process for one product-class. It involves active as well as 
passive management on two different levels. On the strategic level a so-called 
reference portfolio is specified which is valid for the specific product class 
and should guide the fund manager for a specific period of time. On the 
operational level this pre-defined mix of assets has to be adapted by the fund 
managers as precisely as possible for the different individual funds on a daily 
basis respecting all the fund-specific investment guidelines. For the purpose 
of evaluating the performance of the fund (and the fund managers) with each 
fund is associated a specific market index, for instance the Lehmann Brother 
Euro Aggregate, as so-called benchmark. Over time sell and buy transactions 
have to be performed in order to maintain the portfolio feasible with respect 
to the guidelines as well as to keep the deviation of the fund from the reference 
portfolio as small as possible. This daily decision problem on transactions is 
the focus of our study and DSS. Obviously, the model for the operational 
problem has to incorporate the intention of the strategic decision. Thus we 
first have to analyze the process on the strategic level. 



2.1 Strategic Problem: Construction of the Reference Portfolio 

The construction of the reference portfolio is performed in five successive 
steps. In the first four steps specific target values for different criteria are 
specified and in the last step an appropriate portfolio is set up, i.e. a set 
of assets and shares is fixed. In the following we shortly list the criteria for 
the four steps since these criteria are also relevant for our model for the 
operational level. 

• Criterion 1: Interest rate risk: Here a target duration of the reference 
portfolio and the percentage of investment in each of a set of pre-defined 
segments of the yield curve is specified. 

• Criterion 2: Credit risk : Here the portion of investment in non-government 
bonds (i.e. credits) is specified in total as well as for each segment on the 
credit yield curve. 
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• Criterion 3: Segment: Here the investment share for the different segments 
is specified. 

• Criterion 4 : Rating: The financial standing of the portfolio is specified in 
terms of an pre-defined average rating. 

2.2 Operational Level: Approximating the Reference Portfolio 

For each specific fund there exist specific investment guidelines which have 
have to be fulfilled. This aspect has not been observed on the strategic level 
and thus it is usually not feasible to implement the proposal of the reference 
portfolio. Therefore other shares and other assets of the asset universe have 
to be selected. Here we can distinguish three classes of investment guidelines: 
Legal guidelines are formulated in national capital investment laws like the 
German law on investment trust companies (KAGG) and they have to be 
obeyed by every investment fund. For our application mainly §8a KAGG is 
relevant for the bond portfolio optimization. Contractual guidelines reflect 
the specific investment policy of the fund often negotiated with the investor 
and are obligatory for this specific fund only. Internal guidelines reflect the 
policy of the firm or the group of fund managers or are set by the financial 
market, respectively. These constraints may be more ’’soft” in nature, i.e. 
they may be violated by the fund manager temporarily. Here, we are mainly 
confronted with the following constraints: 

1. Lot-sizes restrict the order value for each asset to a positive multiplier of 
a pre-defined amount (hard constraints). 

2. Budget Constraints restrict the net asset value (NAV) of the portfolio. 
Note that through transactions this value is reduced by the commission 
fees of the orders (hard constraints). 

3. Cardinality constraints restrict the number of assets in a portfolio to fall 
into a specific interval (soft constraints). 

4. Bounds on industrial sectors give for each industrial sector a maximum 
allowable deviation from the reference portfolio (hard/soft constraints). 

5. Rating and Liquidity constraints restrict the average ratings and the 
shares for investments in the different segments (hard/soft constraints). 

Note that the last two classes of internal guidelines are representing aspects 
of the model guiding the construction of the reference portfolio. In the next 
section we state an optimization model for generating transaction proposals 
which ensure the construction or restructuring of portfolios with respect to 
the investment guidelines which ” imitate” the intentions of the reference port- 
folio. In addition to the strategic criteria which define a measure of distance 
of a portfolio ( the solution portfolio) to the reference portfolio we introduce 
into the objective of our optimization model an excess return measure with 
respect to the benchmark portfolio as well as transaction costs for restruc- 
turing the actual portfolio. In figure 1 the relationship of these concepts is 
summarized. 
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Fig. 1. Relationship and interaction of the different concepts 



3 The Optimization Model 

Let I the asset universe and N := \I\ the cardinality of the asset universe. 
Then I is partitioned into three sets: I a the set of bonds, Ip the set of inter- 
est rate futures and one (virtual) cash asset i c . For each asset i G / the value 
Hi G It gives the nominal value in the portfolio and vector y = (yi, . . . , yjv) 
represents a (solution) portfolio. Analogously we define the actual portfolio as 
y = (yi, . . . , yw), the reference portfolio as y = (yi, . . . , ypr) and the bench- 
mark portfolio as y — (yi, . . . , y#). Note that for algorithmic purpose i.e. 
during a local search for instance the use of shares for representing portfolios 
instead of nominal values is more usual and appropriate. 

With every asset in the universe we associate the following values: 

li G 7L+ lot-size for asset i G I a to be met when buying/selling, 

-P/% P? bid resp. ask price of asset i G I (where the percentage 
quotations are eliminated by dividing through 100), 
cf,c~ commission fees for buying/selling. 

For given nominal values yi (i G I \ Ic) the value MVi = yiP^ gives the 
so-called current value or market value. NAV (y) denotes the net asset value , 
i.e. total market value of portfolio y. 

Assume that y is constructed from y by a sequence of orders then the 
cash (market) value can be calculated as 

MVi c = Vi c ■ 1 + max{0, & - yi}Pf - max{0, y, - yi}P t B 
i£Ia i£lA 

V v ' ' v ' 

sale purchase 
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- ( 5Z C i • max &i ~ Vi} P f + C i ' max {^ - Vi} P f) (!) 

i£lA i£lA 

V v ' 

commission fees 

From an algorithmic point of view the classification of guidelines stated in the 
last section is irrelevant. In a first formal analysis we have grammaticized all 
guidelines occurring within the investment company and we have developed a 
categorization which enables a standard machine-interpretable representation 
and flexible algorithmic treatment of the vast universe of guidelines. Every 
guideline can be thought of being composed from a function g on the set of 
portfolio vectors and a threshold value. The basic concept of our categoriza- 
tion is that of a bundle i.e. a specific subset of assets. Here we distinguish the 
following types of guideline-constraints: 

1. Weighted bundle constraints (WB) restrict the weighted sum of the mar- 
ket values over all assets in the bundle relative to the NAV of the portfolio 
as threshold. 

2. Conditional bundle constraints ( CB) are weighted bundle constraints which 
have to be fulfilled if and only if for a (possibly different) bundle the 
turnover relative to specific portfolio (usually the current portfolio) ex- 
ceeds a specific threshold value. 

3. Turnover bundle constraints (TB) restrict the turnover rate for a spec- 
ified bundle of assets relative to a second portfolio (usually the current 
portfolio). 

4. Dynamic bundle constraints (DB) restrict the sum of the function values 
over a specified set of non- violated weighted bundle constraints. 

5. Exclusion constraints exclude the assets of a specified bundle from the 
asset universe, i.e. the associated nominal values have are fixed to zero. 

6. Cardinality constraints (CC) limit the number of assets from a specified 
bundle which are allowed to enter the portfolio. 

7. Fixed-value constraints (FV) require that the nominal value of a specified 
asset attains a fixed value, i.e. remains unchanged for instance. 

Now let G be the set of all investment guidelines, then we partition G into 
G = G WB U G CB U G TB U G DB U G cc U G FV . Given a guideline(-function) 
g and a portfolio y we define a boolean function Ful(g,y) which attains the 
value 1 if g is fulfilled by y and 0 otherwise and function Pen{g,y ) G 1R+ 
quantifies the violation with respect to the threshold if Ful(g,y) = 0 and is 
set to 0 else. 

The objective function of our optimization model is a linear combination 
of three components which measure the distance of the solution portfolio to 
the current portfolio, the reference portfolio and the benchmark portfolio: 

• ER(y , y) is the estimated excess return of y over y 

• DIST(y,y ) is the deviation of y to y in terms of the criteria of the 
strategic level 
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• TAC(y,y) are the transaction costs for implementing y starting from y. 
Now we can state the model on an abstract level as follows: 



min -fiR • ER(y, y) + fj, D * DIST(y, y) 4 - \i T * TAC(y , y) (2a) 

s.t. Ful(g,y) = 1 (for all g E G) (2b) 

^ MVi = NAV(y) (2c) 

i€l\I F 

Vi — Vi — OLi li with (Xi eTL (for all i El) (2d) 



(2c) is the budget constraint and (2d) represents the lot-size constraints. Note 
that the specification of the /i-parameters in (2a) is part of the organizational 
implementation and institutionalization of the DSS which is based on this 
model. 



4 The Heuristic Approach 

Within the DSS which we have developed for assisting the fund managers we 
apply a local search based metaheuristic approach for solving the optimiza- 
tion model by adapting and extending the DSS-generator PM-DSS which we 
have developed and applied for stock management problems (see [2]). As al- 
ready described in [2] , [3] the set of guideline constraints G is partitioned into 
three classes, i.e. G = G check U G pen U G move with the following intention: 
Each guideline g E G pen is relaxed in a Lagrangean fashion, i.e. the individ- 
ual violations Pen(g,y) are penalized and added to the objective function 
as penalty term. Each guideline g E G check is treated by a check procedure, 
which evaluates the individual functions Ful(g,y). This information is then 
used to eventually reject a tentative move during the local search. All guide- 
lines g E G move are fulfilled within the heuristic search process through an 
appropriate neighborhood topology. Note that this partitioning is dependent 
on the actual set of guidelines which are relevant for the specific fund. 

In the following we outline the design of the neighborhood topology /move- 
operator for the local search procedures. We have already argued in the stock 
management application where the objective function as well as the system 
of constraints is less complex that the use of ” simple moves” which allow a 
fast evaluation is essential with respect to computational feasibility (see [3]). 

For this complex model the neighborhood definition is based on the so- 
called 1- asset move operator y i— > y ' . Here we alter the nominal value yi 
for a specific asset i by a multiple S E 7L of the corresponding lot-size and 
we simply compensate this change by a corresponding modification of the 
cash-asset for which no lot-size constraint has to be considered: 



y'i ■= Vi + 6 ■ k 



with S E 7L for an i E I a U If 



(3) 
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Thus this operator has two parameters, the asset i and the discrete step size 
5. Let y c denote the current nominal value of the cash asset then the following 
holds: 



NAv(y') = = ( E VjP? + y'iP?) + y'c 

= E% p f + ShP i G + y' c 

jei A 

= NAV(y) + 6liP z G + fi(8) (4) 



The function fi(5) describes the change in the nominal value of the cash asset 
depending on the choice of 5. Here, we have to distinguish two cases: 

(1) yi — yi > 0, i.e. a purchase of asset i (relative to y) 

(2) yi — yi < 0, i.e. a sale of asset i (relative to y) 

For both cases fi(S) is a continuous monotonically decreasing function com- 
posed from two linear functions 



_ f ci 5 + (b — ci a) ; 6 < a 
\ C 2 S + (b — C 2 a) ; S > a 

= max{ci<5 — cia, 0} + min{c 2 ^ — C 2 a, 0 } + b 



(5a) 

(5b) 



with ci, C 2 < 0. 

We have developed formulas for all the above stated constraints/guideline 
classes which given an asset i determine the intervall/set of feasible step 
sizes 5. During the search we first select the parameter i for a move and we 
successively check all guidelines in order to determine the set of feasible step- 
sizes, i.e. the set of 5-values such that each guideline g G G move is fulfilled. 
Then we determine a feasible step-size according to a specific criterion based 
on the the change in the objective function. 

We have embedded this search strategy into a Best First , a Simulated 
Annealing and a Tabu Search meta- heuristic (cf. [4]). Note that the use of the 
simple 1-asset move operator allows a highly flexible application of the search 
strategies, obviously the class of two- asset-moves which we have introduced 
for the tracking error minimization model in stock management can easily be 
simulated. For solving the optimization model we apply a hybrid multi-stage 
approach which we outline in the sequel: 

• Phase 0 : (Preprocessing): 

In a preprocessing phase we eliminate those assets from the asset uni- 
verse for which exclusion constraints are valid and we analyze the set 
of guidelines and eliminate constraints which are dominated by other 
constraints. Then in an optional next preprocessing step we formulate a 
relaxation of our optimization model incorporating the lot-size and bud- 
get constraints as well as all weighted bundle, turnover bundle and fixed 
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value constraints. The resulting mixed integer program is then solved by 
a standard MIP-solver. The intention of this optional step is to gener- 
ate a good starting solution for the subsequent search, to identify more 
redundant constraints and eventually to proof infeasibility. 

• Phase 1 (Generating feasibility): 

Here local search is started either from the solution of the MIP-problem 
or from the current portfolio y. In the latter case, we first have to con- 
struct a solution which fulfills the fixed value constraints by performing 
appropriate moves. Then we apply a local search heuristic with the par- 
titioning G check := 0, G move := {g e G WB U G TB U G CB U G DB \ 
Ful(g,y) = 1}, G pen G \ G move and the auxiliary objective function 
F(y) := J2g G Gpen Pen{g,y ) until a feasible solution is obtained. 

• Phase 2 (Improving while maintaining feasibility): 

After phase 1 returns a feasible solution we apply a local search heuristic 
with the following partitioning G check := 0, G move := G, G pen := 0 and 
the original objective function of the optimization model. 

Note that in phase 1 and 2 we may apply different local search procedures. 
Such a flexibility is appropriate since the constraints as well as the neighbor- 
hoods are different in both phases. 

5 Final Remarks 

Within a still ongoing research project we have developed in cooperation 
with a leading German investment trust company a personalized decision 
support system which is based on this approach and which serves to assist 
the fund managers within bond fund management. The implementation was 
performed by customizing PM-DSS, a DSS-generator for portfolio optimiza- 
tion, which has been developed at our institute and which has already been 
applied successfully to problem instances in passive stock fund management 
(cf. [2] or [3]). In this paper we have described the conceptual aspects of the 
application to bond portfolio management only, a detailed description of the 
implementation as well as results will be given in subsequent papers. 
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Abstract. While the unconstrained portfolio optimization problem can be solved 
efficiently by standard algorithms, this is not the case for the portfolio optimization 
problem with additional real world constraints like cardinality constraints, buy-in 
thresholds, roundlots etc. In this paper we investigate two extensions to Evolu- 
tionary Algorithms (EA) applied to the portfolio optimization problem. First, we 
introduce a problem specific EA representation and then we add a local search 
for feasible solutions to improve the performance of the EA. All algorithms are 
compared on the constrained and unconstrained portfolio optimization problem. 



1 Introduction 

Evolutionary Algorithms (EA) have been successfully applied to many op- 
timization problems in science and technology. Some researchers also used 
EA on financial engineering problems like the portfolio optimization problem 
[4,1,8]. In this paper we compare the impact of several EA solution represen- 
tations and the application of local search on the performance of EA on the 
portfolio optimization problem. 

2 The Portfolio Optimization Problem 

Using the standard Markowitz mean- variance approach [6] , the unconstrained 
portfolio optimization problem is given as 

minimizing the variance of the portfolio : Y^iLi w i ' w j * (l a ) 

maximizing the return of the portfolio : J2iLi w i ' (lb) 

subject to 



Efli Wi = l , (2a) 

0 <w % <\ ; z = l,..,JV (2b) 

where N is the number of assets available, fii the expected return of asset 
z, &ij the covariance between asset z and j, and finally Wi are the decision 
variables giving the composition of the portfolio. 
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The optimization problem as given in Equ. 1 is a multi-objective optimiza- 
tion problem with two competing objectives. First, to minimize the variance 
(risk) of the portfolio and at the same time to maximize the return of the 
portfolio. Equ. 2 gives the minimum constraints for a feasible portfolio. 
While this portfolio optimization problem is a quadratic optimization prob- 
lem for which computationally effective algorithms exist, this is not the case 
if real world constraints are added: 

Cardinality Constraints restrict the number of assets in the portfolio. 

N 

^sign(tüi) = k (3) 

i= 1 

Buy-in Thresholds give the acquisition prices for each asset. 

h<Wi ; i = 1, N (4) 

Roundlots give the smallest volumes fi that can be purchased. 

Wi = yi- fi ; i = 1, N and y t e Z (5) 

Other real world constraints can include sector /industry constraints, immu- 
nization/duration matching and taxation constraints, but these will not be 
addressed in this paper. 

3 The Optimization Algorithm 

To solve the multi-objective optimization problem we use a Multi-Objective 
Evolutionary Algorithm (MOEA) having two different EA representation 
types with an additional problem specific extension for each representation. 
To further improve the results we apply a local search for feasible solutions. 
There are two approaches how to incorporate local search into EA (Memetic 
Algorithms) either using Lamarckism or relying on the Baldwin effect [10]. 



3.1 Evolutionary Algorithms 

EAs are population based stochastic optimization heuristics inspired by Dar- 
win’s Evolution Theory. An EA searches through a solution space in parallel 
by evaluating a set (population) of possible solutions (individuals). An indi- 
vidual gives a solution by representing the decision variables Wi. 

An EA starts with a random initial population Pq. Then the ’fitness’ of each 
individual is determined by evaluating the objective function, Equ. 1. After 
the best individuals P/ are selected, new individuals for the next generation 
Pt+ 1 are created from P/. New individuals are generated by altering the indi- 
viduals of P/ through random mutation and by mixing the decision variables 
of multiple parents through crossover. Then the generational cycle repeats 
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Fig. 1 . EA scheme Fig. 2. Multi- Objective EA Fig. 3. Memetic Alg. 



until a breaking criteria is fulfilled, see Fig. 1 for a basic scheme. 

There are several alternative EA implementations but only two will be con- 
sidered in this paper: Genetic Algorithms (GA) [5] are based on a binary 
representation for real value decision variables and rely on big populations 
and the crossover operation. Evolutionary Strategies (ES) [9] on the other 
hand use a direct real value representation and apply sophisticated mutation 
operators. An extensive overview on EAs can be found in [2]. 

3.2 Multi- Objective Evolutionary Algorithms 

Due to the population based search strategy and the simple selection strategy 
EAs are easy to extend to multi-objective optimization problems. First, by 
using selection based on multiple objective values like the Pareto-dominance 
criteria. Secondly by adding an archive population A t used to maintain the 
currently known Pareto-front. Zitzler gives a guide to MOEAs in his Ph.D. 
Thesis [12]. 

During multi-objective optimization two goals are to be reached. On the one 
hand the solutions should be as close to the global Pareto-optimal front as 
possible and on the other hand the solutions should also cover the whole 
Pareto- front. The first goal is often achieved through elitism by replacing 
random individuals in P t with individuals on the Pareto- front At, see Fig. 2. 
The second goal can be achieved by punishing individuals that are too close 
together (Fitness Sharing). 

3.3 Memetic Algorithms 

Memetic Algorithms (MA) [7] extend EA by adding an arbitrary (possibly 
problem specific) local search heuristic before evaluating the population P t , 
see Fig. 3. There are two alternatives of how to integrate the local search 
[10], first by updating only the enhanced objective values (fitness) for each 
individual (Baldwin Effect) or by also updating the decision variables, so that 
they can be inherited to the next generation (Lamarckism). An example for 
MA on the portfolio optimization problem is given in [8]. 
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4 Experimental Settings 

In our experiments we apply a generational GA population strategy with a 
population size of 500 individuals. We use tournament selection with a tour- 
nament group size of 8 together with objective space based fitness sharing 
with a sharing distance of a share — 0.01. The selection mechanism prefers 
individuals that are better than other individuals in at least one objective 
value, i.e. are not dominated by another individual. To maintain the currently 
known Pareto-front we use an archive of 250 individuals and use A t as elite 
to achieve a faster speed of convergence. Details of this MOEA strategy can 
be found in [11]. 

We use two different standard EA representations on the portfolio optimiza- 
tion problem: First, a GA binary representation with a 32 bit standard binary 
encoding (genotype) for each Wi (phenotype). A 3-point-crossover and one- 
point-mutation is used on the GA genotype, with a crossover probability of 
(P c = 1.0) and mutation probability of (P m = 0.01). Secondly we use an ES 
with a real- valued solution representation. In this case the phenotype equals 
the genotype. We apply a discrete 3-Point-Crossover ( P c = 0.5) and local 
mutation with one strategy parameter for each decision variable (P m = 1.0) 
on the ES genotype. These parameters were selected from preliminary exper- 
iments. 

The idea to use a problem specific representation for the portfolio optimiza- 
tion problem is based on the fact that portfolios on the Pareto-front are rarely 
composed of all available assets, but only a limited selection of assets. The 
actual composition of the assets in the portfolio resembles a one-dimensional 
binary knapsack problem. To allow easy removal and adding of assets to the 
portfolio we added an auxiliary binary bit-mask bi together with the decision 
variables Wi to represent a solution. Each bit bi determines whether the as- 
sociated asset will be element of the portfolio or not, w[ = bi • W{. Both EAs 
were enhanced with this additional ’knapsack’ representation. The extended 
EAs will be referred to as Knapsack-GA (KG A) and Knapsack-ES (KES). 
The second extension is made to improve the number of feasible solutions gen- 
erated by the EA. Instead of punishing or rejecting infeasible solutions, we 
apply a ’local search heuristic’ to convert an infeasible solution into a feasible 
one. For example to hold Equ. 2 we limit the range of the EA solution repre- 
sentation and use a standardization step w[ = Wi/J2f= i w j • For cardinality 
constraints we set all but the k biggest decision variables Wi to zero before 
standardization. Similar mechanisms were applied for buy-in thresholds and 
roundlot constraints. 

5 Results 

The comparison of the different EA implementations was performed on bench- 
mark data sets given by Beasley [3] . The numerical results presented here are 
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performed on the Hang Seng data set with 31 assets. 

To compare the performance we measure the percentage difference ( A area ) 
between the area below the Pareto-front generated by the EA and the area 
below the unconstrained Pareto-front given as reference solution, see Fig. 8. 
For each experiment 50 independent runs each with 100.000 fitness evalua- 
tions were made. For these we calculate the mean, standard deviation, max- 
imum and minimum values and the 90 % confidence interval of the A area , 
which is to be minimized. 



5.1 Adding the Knapsack representation to the EA individuals 



When comparing the GA and ES against the KGA and KES without ad- 
ditional constraints (no li and fi) the extended versions clearly outperform 
the standard EA approaches, see Fig. 4. Especially the KES shows very good 
convergence behavior. Only in case of k = 2 the GA and ES are able to catch 
up with the extended EA representations. This shows that the assumption 
that the portfolio optimization problem resembles the binary knapsack prob- 
lem holds true even without cardinality constraints and that the extended 
representation is able to search more efficiently than the standard EAs. 
With additional buy-in thresholds and roundlots ( k =0.1 and fi = 0.02) all 
algorithms performed much worse, see Fig. 5. Although single runs of the ex- 
tended EAs find reasonable good solutions, the results are rather unreliable. 




Fig. 4. A are a for Hang Seng without U and fi 



no cardinality constraints 




CD 



GA ES KGA KES 




cardinality k = 2 




Fig. 5. Aarea for Hang Seng with k = 0.1 and fi = 0.02 
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Fig. 6. Aarea for Hang Seng with Lamarckism and without U and fi 



no cardinaltiy constraints 



cardinality k = 6 




Fig. 7. Aarea for Hang Seng with Lamarckism and U — 0.1 and fi = 0.02 
5.2 Applying Lamarckism 



The main advantage of the extended EA seems to be the ability to easily 
change the content of the portfolio. The same effect could be achieved if local 
search with Lamarckism is used. With Lamarckism assets removed by local 
search would cause the decision variables to be set to zero. Therefore the 
resulting vector of decision variables Wi would be sparse. On such a sparse 
vector single mutations and crossover could cause major changes of the con- 
tent of the portfolio. With this, standard EAs could move as easily through 
the space of assets combinations as the extended EA. 

The experiments with Lamarckism supports this view, see Fig. 6. The stan- 
dard EAs become competitive to the extended EAs and especially the ES 
behaves nearly as good as the KES except for the unconstrained portfolio 
optimization. In the latter case, Lamarckism can not have the same effect 
since no assets are removed through local search. 

In case of additional constraints all algorithms perform much better and 
the results become more reliable, see Fig. 7. Even the extended EAs bene- 
fit from the Lamarckism because the extended representation is as improper 
for the discretization of the search space through the roundlot constraints 
as the standard EAs are for searching for portfolios with limited cardinality. 
Remarkably, the KES with Lamarckism seems to perform as well as in the 
unconstrained case. Most likely the discretization of the Pareto- front through 
the limited archive size levels the effect of the roundlot constraint. 
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6 Conclusions and Future Work 

We have shown that the extended EA with the additional knapsack repre- 
sentation is able to solve the portfolio optimization problem more efficiently 
than the standard EA approaches, due to the improved search capabilities 
regarding the possible combinations of assets in a portfolio. The KES showed 
to be superior to the KGA due to the more appropriate ES real- value repre- 
sentation of the decision variables Wi . We were also able to produce the same 
effect by using the Memetic feasibility search in combination with Lamarck- 
ism. In this case the standard EAs were able to draw level with the extended 
EAs and as before the ES with Lamarckism produced better results than the 
GA with Lamarckism and even better than the KGA. 

With additional constraints all algorithms performed not as well except a 
few good outliers when using the extended EA. Again, Lamarckism is able to 
improve the algorithms. With Lamarckism the KES reliably produces results 
only sightly worse than in the unconstrained case. Preliminary experiments 
hint that a discrete representation for KGA performs much better in case of 
roundlot constraints and produces equally good results. 

Our future research will concentrate on improving the Multi-Objective EA 
and comparing alternative Multi-Objective EAs on the portfolio selection 
problem. Another area of improvement could be the local search. There are 
numerous alternatives to the simple search for feasible solutions, but they 
have to be carefully evaluated regarding the ability to handle additional con- 
straints. 
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Abstract. By mid 2004, the Basel Committee on Banking Supervision (BCBS) is 
expected to launch its final recommendations on minimum capital requirements in 
the banking industry. Although there is the intention to arrive at capital charges 
which concur with economic intuition, the risk weight formulas proposed by the 
committee will lack an adequate treatment of concentration risks in credit portfo- 
lios. The question arises whether this problem can be solved without recourse to 
fully-fledged portfolio models. Since recent practical experience shows that the risk 
measure Conditional Value-at-Risk (CVaR) is particularly well suited for detecting 
concentrations, we develop the semi- asymptotic approach by Emmer and Tasche in 
the CVaR context and compare it with the capital charges recently suggested by 
the Basel Committee. Both approaches are based on the same Vasicek one-factor 
model. 



1 Introduction 

From an economic point of view, the risks that arise in a portfolio need to be 
covered by a corresponding amount of capital that is applied as a cushion to 
absorb potential losses. The question of calculating the risk contributions of 
single assets in a portfolio corresponds to the problem of calculating capital 
charges to cover occurring loss risks. This allocation issue can be considered 
as well from a regulatory as well as from an internal perspective, leading to 
capital charges per asset by the regulatory and the economic capital, respec- 
tively. 

Considering the different regulations for credit risk, we observe that in the 
current regulatory regime (Basel I Accord) almost no risk adjustment can be 
identified. By mid 2004, the BCBS is expected to launch its final recom- 
mendations on new minimum capital requirements in the banking industry 
(Basel II Accord) . Although there is the intention to arrive at improved more 
risk sensitive capital charges of the credit risk bearing assets, the risk weight 
formulas proposed by the committee will lack an adequate treatment of con- 
centration risks in credit portfolios as we will show below. The main problem 
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is that the Basle II model assumes that all credits are of equal, infinites- 
imal small exposure, i.e. that the credit portfolio is infinitely fine grained. 
However, in real world portfolios, this basic assumption does not hold. 

From an internal perspective, banks are putting high efforts into the de- 
velopment of internal credit risk models that allow the risk measurement of 
the portfolio credit risk. Comprehensive research work has been done to de- 
velop methods of how to calculate risk contributions in an appropriate way 
(see e.g. [4], [7], [9], [11], [12]). However, from a practical point of view, the 
allocation problem, i.e. the question of how the single assets contribute to the 
overall portfolio risk, cannot yet be considered as solved. Risks are broken 
down in different ways, taking into account correlation effects and concen- 
tration risk to different extents (see e.g. [3]). Banks that are using internal 
credit risk models in most cases need enormous calculation efforts to esti- 
mate the overall portfolio risk and the risk contributions of single assets and 
sub-portfolios. 

In this paper, we give a survey on an approach to calculate risk contri- 
butions of single assets in an analytical way that avoids calculation intensive 
simulation efforts. This semi- asymptotic approach slightly extends the Basel 
II approach and takes into account concentration effects. Thus, it can be 
viewed as a bridging to relate regulatory and internal risk measurement. Ad- 
ditionally, it is based on the new risk measure of Conditional Value at Risk 
that has been proven to be appropriate for bank wide loss risk measurement 
(see for instance [1], [10], [12]). 

The paper is organized as follows. In Section 2 we briefly introduce the 
capital charges as they are suggested by the Basel Committee. Section 3 
presents the semi- asymptotic approach to capital charges in case of CVaR as 
risk measure. In Section 4 we illustrate the both approaches with a numerical 
example. 

2 The Basel II Model 

We give a short presentation of the reasoning that lead to the current sug- 
gestions by the Basel Committee. In particular, we introduce the so-called 
Vasicek one-factor model that was originally proposed in [6] for use in the 
forthcoming rules on capital charges. 

We consider a portfolio loss variable L n that is defined by 

n 

Ln = L n (ui,...,u n ) — ^ Ui (1) 

i—l 

where Ui > 0, i = 1 , . . . , n, denotes the weight or the exposure of asset i in the 
portfolio, 0 < pi < 1 and Ci > 0, i = 1, . . . , n, are constants, and -V, £i, . . . , 
are independent random variables with continuous distributions. The con- 
stants Ci are called default thresholds. They have to be calibrated in order to 
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fix the probabilities of default of the assets. The random variable X is inter- 
preted as the change of an economic factor that influences all the assets in the 
portfolio but to different extents. The so-called asset correlation pi measures 
the degree of the i-th asset’s exposure to the systematic risk expressed by X. 
The random variables & are assumed to model the idiosyncratic (or specific) 
risk of the assets. 

Equation (1) implies the following representation for the conditional vari- 
ance of the loss L n given X 

var[L n | X = x] = £u?P[& < (l - P[& < (2) 

i = 1 

We assume that the probabilities of default are not too small and that the 
correlations with the economic factor are not too high, i.e. in precise terms 
that inf iCi > — oo and sup^p* < 1. Then from (2) it follows that in case of 
independent, identically distributed ^ 1 ,^ 2 , •• • we have 



lim E|var[L n I X]] =0 if and only if 1 lim v? = 0. (3) 

n— mx) L J n— * 00 < f 

i = 1 

Since 

var [L n ] = E [var [L n | X]] + var [E [L n | X]] , (4) 

the conditional expectation E[L n | X] appears to be a natural approximation 
of L n as soon as (3) is fulfilled, i.e. as soon as the concentrations in the 
portfolio are not too big. Indeed, the approximation 

L n » E[L n \X] (5) 

is fundamental for the Basel II approach to credit risk capital charges. For 
a G (0, 1) and any random variable Y, define the a-quantile (or the Value- 
at-Risk (VaR)) of Y by 

q a (Y) = VaR a (F) = inf{y e R : P[F <y]> a}. (6) 

Note that 

E[L n \X = x\ = < c -^0f}. (7) 

i = 1 

Since the right-hand side of (7) is a decreasing function in x, one then deduces 
from (5) that 

?«(£n) * I> P [& < Ci ~' / ^f (X) ] ■ ( 8a ) 

i= 1 



1 Of course, here we admit an additional dependence of ui on n, i.e. Ui — Ui, n . 
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Assuming that the & are all standard normally distributed then yields 

$«(£») * ib u ^( ci ~ v ^ a(x) )’ ( §b ) 

2—1 

where $ denotes the standard normal distribution function. The linearity of 
the right-hand side of ( 8 b) in the vector (ui, . . . , u n ) suggests the choice of 

Basel II charge(i) = Ui@( ' X ~ ) (9) 

as the capital requirement of asset i in the portfolio with the loss variable 
L n . Up to an adjustment for the maturity of the loan which can be neglected 
in the context of this paper, (9) is just the form of the risk weight functions 
that was provided by the BCBS in [2]. 

3 Calculating Risk Contributions with the 
Semi- Asymptotic Approach 

3.1 Definition of Semi- Asymptotic Capital Charges 

In the following we review the approach by [5] for the definition of the risk 
contributions of single credit assets if risk is measured with Value- at- Risk (or 
just a quantile at fixed level). However, we consider here the risk measure 
Conditional Value-at-Risk which turned out to be more attractive from a 
conceptual point of view. We call our approach semi- asymptotic because, in 
contrast to Basel II where all exposures are assumed to be infinitely small, 
we keep one exposure fixed and let the others tend to infinitely small size. 

We consider here a special case of ( 1 ) where pi = r, c\ — a but pi = p 

and Ci = c for i > 1 , and J27=i u i~ 1* Additionally, we assume that u\— u 

is a constant for all n but that U 2 , us 1 . . . fulfills (3). 

In this case, the portfolio loss can be represented by 

L n (u,u 2 ,...,w n ) = + 

n 

c 1 ( io ) 

i= 2 

with 2 u i = 1* Transition to the limit for n — > oo in (10) leads to the 
semi- asymptotic percentage loss function 

L(u) = uln + (1 — u)Y ( 11 ) 

with D = {y/rX + y/1 — r £ < a} and Y = P[£ < ^ 7 ==] . Of course, 

a natural choice for r might be r = p, the mean portfolio asset correlation. 




265 



For a G (0, 1) and any random variable Z, define the the Conditional Value- 
at-Risk (CVaR) (or Expected Shortfall, see [1]) at level a of Z by 

CVaR a (Z) - E[Z | Z > q a (Z )\ . (12a) 



As by (11) we have 

CVaR a (L(u)) = uP[D\L(u) > q a (L(u))} 

+ (l-u)E[Y\L(u)>q a (L(u))}, (12b) 

the following definition is rather near at hand. 

The quantity 

uP[D\L(u)>q a (L(u ))] (13) 

is called semi- asymptotic CVaR capital charge (at level a) of the loan with 
exposure u (as percentage of total portfolio exposure ) and default event D as 
in (11). 

The capital charges we suggest in Definition (13) have to be calculated sepa- 
rately, i.e. for each asset an own model of type (11) has to be regarded. This 
corresponds to a bottom-up approach since the total capital requirement for 
the portfolio is determined by adding up all the capital charges of the assets. 
Note that the capital charges of Definition (13) are not portfolio invariant 
in the sense of [6]. However, in contrast to the portfolio invariant charges, 
the semi-asymptotic charges take into account not only correlation but also 
concentration effects. In particular, their dependence on the exposure u is not 
merely linear since also the factor P[D\L(u) > q a (L(u))] depends upon u. 
Definition (13) is in line with the general definition of risk contributions (cf. 
[8], [11]) since (11) can be considered a two- assets portfolio model. 



3.2 Calculation of Semi- Asymptotic Capital Charges 

If Fo and F\ denote the conditional distribution functions of Y given l# — 0 
and Id = 1 respectively, the distribution function of L(u) is given by 



P \L(u)<z\ = pF 1 (^-^)+(l -p)Po(j 3 ^), (14) 



where p = P[D] is the default probability of the loan under consideration. By 
means of (14), the quantile q a (L(u)) can be numerically computed. For the 
conditional probability which is part of Definition (13), we obtain 



P[D\L(u) >z] 



P \L(u) > z] 



(15) 



Denote by ^> 2 (*, •; 0) the distribution function of the bivariate standard normal 
distribution with correlation 0. If we assume that X and £ are independent 
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and both standard normally distributed, we obtain p = 3>(a), and can derive 
for the conditional distribution functions from (14) that 



Fi{z) 



1 -P 1 $ 2 (a, ~ z€(0,l) 

0, otherwise, 



(16a) 



and 



F 0 (z) = 



(1 -p)-^(-fl,- c -^' lw ;Vy), ^ € (0,1) 

0, otherwise. 



(16b) 



Let, similarly to the case of (16a) and (16b), @3 (*,*,•; E) denote the distribu- 
tion function of the tri- variate standard normal distribution with correlation 
matrix E. Define the function g by 



g(x,ß,z) 



X — y/l — ß 1 (z) 

7ß 



(17a) 



and the correlation matrix E p , r by 



I 1 y/PT y/p\ 

Zp,t=[VPT 1 V 7 b ( 17b ) 

\ y/P V 7 1 / 



Then, in order to arrive at CVaR a (L(w)), the conditional expectation of Y 
given {L{u) > z } from (12b) can be calculated according to 



E[Y\L(u)>z\ = P[L(u)>z]- 1 ($ 3 (c,a,g(c,p,fE%);F P , T ) + 

$ 2 (c,g(c,p, jz^);yp) -$ 3 (c,a,g(c,p,j^);i: PtT )y (17c) 



4 Numerical Example 

We illustrate the previous results by a numerical example. In our focus is a 
portfolio that is driven by systematic risk only (the variable Y in (11)) and 
enlarge this portfolio with an additional loan (the indicator Id in (11)). 

In our example, the portfolio modeled by Y has a quite moderate credit 
standing which is expressed by its expected loss E[Y] = 0.025 = #(c). By 
choosing p = 0.1 as asset correlation we arrive at a portfolio with a rather 
strong exposure to systematic risk. For the sake of simplicity we choose r = p, 
i.e. the exposure to systematic risk of the additional loan is identical to the 
exposure of the existing portfolio. However, we assume that the additional 
loan enjoys a quite high credit- worthiness as we set p = P[D] = 0.002 = ^(a). 

Figure 1 illustrates the relative contribution of the new loan to the risk of 
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Risk contribution of new loan: different approaches 




Fig.l. Relative risk contribution of new loan as function of the relative 
weight of the new loan. Comparison of contribution to true Conditional 
Value-at-Risk (CVaR), and the contributions according to the Basel II 
and Basel I Accords. 



the portfolio loss variable L(u). The contribution is expressed as a function of 
the relative weight u of the new loan in the portfolio and calculated according 
to three different methods. The first of the depicted methods relates to the 
relative contribution to true portfolio CVaR at level a — 99.9%, defined as the 
ratio of the contribution to CVaR according to Definition (13) and portfolio 
CVaR, i.e. the function 



uP[D\L(u)>q a (L(u))} 
CVaR <*(£(«)) 



(18) 



where the conditional probability has to be evaluated by means of (15) and 
(16a). In the denominator, CVaR is calculated according to (12b) and (17c). 
Moreover, curves are drawn for the Basel II approach, i.e. the function 



“* r~ v 5fe“ m ) + a - ' 



U I — > 



(19) 
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and the Basel I approach. The latter approach just entails the diagonal as 
risk contribution curve since it corresponds to purely volume-oriented capital 
allocation. 

Note that in Figure 1 the true CVaR curve intersects the diagonal (Basel I 
curve) just at the relative weight u* that corresponds to the minimum risk 
portfolio L{u*). The Basel II curve differs strongly from the true contribution 
curve and is completely situated below the diagonal. This fact could yield the 
misleading impression that an arbitrarily high exposure to the additional loan 
still improves the risk of the portfolio. However, as the true CVaR curve in 
Figure 1 shows, the diversification effect from pooling with the new loan stops 
at 5.8% relative weight. 

To sum up, it can be said that the example shows a shortcoming of the 
new Basel II capital requirement rules as they are not sensitive to concentra- 
tions. In addition, the example presents an intuitive bottom-up approach for 
calculating contributions that is sensitive to correlation as well as to concen- 
trations and avoids time-consuming simulations. 
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Zusammenfassung Die fortwährende Anwendung von Simulationsmodellen im 
Geschäftsprozess der taktischen Produktionsplanung scheitert oft an der 
Schwierigkeit, die Modellparameter immer auf dem aktuellen Stand zu halten. 
Dies ist umso schwieriger, je größer die Modelle werden. Allerdings ist gerade der 
Einsatz solcher Simulationsmethoden bei komplexen Modellen umso wichtiger, 
da z.B. Auswirkungen von geänderten Produktionsraten und Produktportfolios 
nicht direkt erkennbar sind. In diesem Beitrag wird beschrieben, wie das auf 
Warteschlangennetzwerken basierende Simulationsmodell EPOS (Enterprise 
Production Planning and Optimization System) der IBM als integriertes 
Simulationsmodell in die Planungsprozesse der IBM im Bereich der Festplatten- 
fertigung eingebettet wurde. Dabei werden die mathematischen Grundlagen, der 
entwickelte Geschäftsprozess sowie Erfahrungen aus der betrieblichen Praxis 
dargelegt. 



1 Einleitung 

Die Notwendigkeit des Einsatzes von Simulationsmethoden, insbesondere zur 
Analyse komplexer Fertigungssysteme, ist unbestritten. Doch gerade für komplexe 
Fertigungssysteme ist es sehr schwierig die Modellparameter immer aktuell zu 
halten. Dies ist aber wiederum die Voraussetzung, um kurzfristige Simulationsan- 
fragen befriedigen zu können. Soll die Simulation in einen übergeordneten 
Planungsprozess eingebunden und fortwährend genutzt werden, ist ein aktueller 
Datensatz umso wichtiger. Neben der Aktualität der Modellparameter ist eine 
schnelle Antwortzeit des Simulationssystems für den fortwährenden Einsatz 
enorm wichtig. 
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In der vorliegenden Arbeit wird beschrieben, wie das Problem der zeitnahen 
Aktualisierung der Daten und der Rechengeschwindigkeit mittels des integrierten 
Simulationssystems EPOS (Enterprise Production Planning and Optimization 
System) in der IBM Festplattenproduktion gelöst wurde. Ausgangspunkt ist die 
übergeordnete Hauptprogrammplanung für die weltweiten Fertigungsstätten von 
Festplatten und Komponenten. Nach einer kurzen Erläuterung der Schwierigkeiten 
bei der Hauptprogrammplanung im Umfeld der Festplattenindustrie werden die 
sich daraus resultierenden Anforderungen an den globalen Planungsprozess 
beschrieben. Im folgenden wird dann die Rolle der Simulation in diesem Prozess 
mit den speziellen Herausforderungen erklärt. Anschließend wird die Integration 
des Simulationssystems EPOS in diesen Planungsprozess erläutert. Insbesondere 
wird dabei dargelegt, wie die nötige Datenaktualität sichergestellt werden konnte 
und wie mittels der Verwendung von Warteschlangenmethoden die notwendigen 
Antworzeiten für die Simulation erreicht wurden. 



2 Planungsumfeld 

Die Fertigung von Festplatten zeichnet sich durch eine hohe Fertigungstiefe aus 
(Abb.l). Dabei fanden die Fertigung der sogenannten Technologie-Komponenten 
(Schreib-Lese-Kopf (Wafer) und Dünnfilmplatte (Disk)) und die abschließenden 
Montageprozesse (Actuator und Laufwerk) bei der IBM statt. Die Komponenten- 
fertigung und die Endmontage war auf über 10 Standorte auf 3 Kontinenten 
verstreut. Andere Komponenten, wie Motor oder Kabel, wurden von Lieferanten 
bezogen. 
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Abb. 1. Erzeugnisstruktur einer Festplatte 

Ziel einer IBM di visions weiten Initiative war es nun, ausgehend von den 
Absatzprognosen, eine zentrale Hauptprogrammplanung für die unterschiedlichen 
Komponenten und Fertigungsstätten unter Berücksichtigung der Kapazitäten an 
den verschiedenen Standorten, der aktuellen Lager- und Umlaufbestände an 
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Halbfabrikaten, sowie der Lieferzusagen der Lieferanten zu etablieren. Bei der 
Umsetzung galt es die für die Festplattenindustrie typischen Randbedingungen mit 
in Betracht zu ziehen. So ist eine Absatzprognose bei den sehr schnell schwan- 
kenden Nachfragen sehr schwierig. Auch sind die Produktlebenszyklen von sechs 
bis neun Monaten sehr kurz. Dabei ändert sich mit jedem neuen Produktanlauf die 
Kapazitätssituation aufgrund der technologischen Unterschiede. Damit ergibt sich 
eine starke Abhängigkeit der maximalen Fertigungskapazität vom jeweiligen 
Produktportfolio. Einen weiteren Einfluss auf die kapazitiven Nebenbedingungen 
haben die großen Variationen der Prozessparameter, wie z.B. die Prozessausbeute. 
Durch die unterschiedliche Komplexität der Komponentenfertigung ergeben sich 
auch große Unterschiede bei den zu planenden Vorlaufzeiten. Hinzu kommt, dass 
aufgrund der Vielzahl an Lieferanten eine Möglichkeit zur Lieferantenkollaborati- 
on geschaffen werden musste, damit verbindliche Lieferzusagen als Nebenbedin- 
gungen mit in die Planung einfließen können [1]. 

Es zeigte sich, dass über das eigentliche System zur Hauptprogrammplanung 
hinaus weitere Systeme zur Bereitstellung der notwendigen Planparameter 
eingeführt werden mussten. Die Abb. 2 skizziert die entsprechende System- 
architektur, von der Hauptprogrammplanung über die Simulation von Kapazitäten 
und Vorlaufzeiten hin zur Lieferantenkollaboration. Im folgenden soll nun die 
Integration der Simulation in diesen Prozess beschrieben werden. 
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Abb. 2. Architektur der Planungssysteme 
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3 Integration der Simulation in die 
Hauptprogrammplanung 

3.1 Prinzip der Integrierten Simulation 

Die wesentlichen Nebenbedingungen der Hauptprogrammplanung sind die 
Kapazitäten an den Fertigungsstandorten. Die Bestimmung und Überprüfung 
dieser Nebenbedingungen ist aufgrund der Komplexität der Produktionslinien 
ohne ein entsprechendes Simulationsmodell nicht möglich. So hat z.B. alleine die 
Wafer-Fertigung pro Produkttyp mehr als 500 Arbeitsschritte, die auf ca. 300 
verschiedenen Maschinen durchgeführt werden können. Hinzu kommt, dass die 
Wafer-Fertigung als typische Halbleiterproduktion mit vielen Schleifen extrem 
unübersichtlich ist, und auch von daher einer simulationsgestützen Planung 
bedarf. Um eine Einbindung der Simulationsergebnisse in die zentrale Hauptpro- 
grammplanung zu erreichen, muss die Simulation als Geschäftsprozess in die 
Planungsabläufe integriert werden. Dabei lässt der strenge Zeitplan der Hauptpro- 
grammplanung nur ein kurzes Zeitfenster von ein bis zwei Tagen für die 
Durchführung der Simulation und der endgültigen Zusage von Fertigungs- 
kapazitäten seitens des lokalen Fertigungsmanagements zu. Damit bleibt dem 
Planer keine Zeit, die Inputparameter des Simulationsmodells zu aktualisieren. 
Darüber hinaus muss die Antwortzeit des Simulationssystems sehr schnell sein, 
damit innerhalb des kurzen Zeitfensters die Durchführung von mehreren 
Simulationsläufen zur Bewertung von Alternativen überhaupt möglich ist. 
Letztendlich muss das Simulationssystem einen automatischen Austausch von 
Input- und Outputparametern mit der übergeordneten Hauptprogrammplanung 
erlauben. 
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Abb. 3. Integrierte Simulation 
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3.2 Verteilte Dateneingabe 

Fasst man allein die Wafer-Fertigung und die Endmontage der europäischen 
Werke zusammen, so ergeben sich über 1200 Arbeitsfolgen - durchgeführt auf 
ungefähr 3500 Maschinen und zusammengefasst zu ca. 550 Workcentern. Bei ca. 
30 Parametern pro Workcenter und ca. 15 Parametern pro Arbeitsfolge wird die zu 
handhabende Datenmenge sehr groß. 

Ein Teil der Parameter liegt schon in Betriebsdatenerfassungssystemen vor und 
wird über die entsprechenden Schnittstellen eingelesen. Andere Parameter müssen 
über manuelle Eingaben dem System zugeführt werden, da sie nicht in Datenban- 
ken verfügbar sind, z.B. Planparameter für zukünftige Produkte. Für diese 
Dateneingabe wurde ein Geschäftsprozess entwickelt und mit Unterstützung von 
EPOS umgesetzt. Vorab wurden die Daten nach den Verantwortungsbereichen 
Wartung, Prozess und Fertigung untergliedert. Der Geschäftsprozess sieht vor, 
dass alle Ingenieure aus diesen drei Bereichen, die für die Inputparameter 
verantwortlich sind, die Möglichkeit der Dateneingabe erhalten. Die Dateneingabe 
muss dann vom Ingenieur selbst und dem verantwortlichen Management 
elektronisch bestätigt werden. Dabei hat die Fertigung das Recht, Parameter der 
anderen Bereiche zurückzuweisen, übernimmt im Gegenzug aber abschließend die 
Verantwortung für die Gültigkeit des gesamten Parametersatzes. Realisiert wurde 
dieses Konzept mit den Systemkomponenten DB/2, Lotus Notes und JAVA [4], 



3.3 Automatische Modellgenerierung 

Auf Grundlage der Datenbasis sollen Simulationsmodelle automatisch generiert 
werden. Die Modellgenerierung vollzieht sich dabei über mehrere Stufen, wobei 
objektorientierte Methoden die Erstellung von komplexen Abbildungen der 
Produktionsanlagen auf Simulationskomponenten erlauben. Auf diese Weise kann 
letztendlich aus einer Ansammlung von Betriebs- und Planungsdaten ein 
Simulationsmodell erstellt werden, dessen Ergebnisse wiederum im Kontext des 
Produktionsplaners interpretiert werden können. Die Transformation der von den 
Ingenieuren eingegebenen Parametern bis zur mathematischen Formel vollzieht 
sich in drei Schritten. Im ersten Schritt wird ein objekt-orientiertes Modell aus der 
Datenbank heraus erzeugt. Im zweiten Schritt wird dieses Modell auf ein 
äquivalentes Warteschlangennetzwerk abgebildet, wobei einzelne Arbeits- 
stationen durch Subnetzwerke ersetzt werden können. Der letzte Schritt ist die 
Generierung des mathematischen Modells. 
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3.4 Analytische Leistungsbewertung 

Bei der Größe der zu simulierenden Fertigungslinien sind Simulationsmodelle auf 
der Basis der diskreten ereignisorientierten stochastischen Simulation zu 
rechenintensiv. Daher wurden Warteschlangennetzwerke aufbauend auf der 
Dekompositionsmethode entwickelt, wie sie in [2], [5] bzw. [6] zu finden ist. Die 
Knoten des Netzwerkes stellen allgemeine Mehrbedienersysteme mit Gruppenan- 
künften und Gruppenbedienung der Form G x /G(b,b)/c dar, die mit Methoden der 
Diffusionsapproximation in geschlossener Form gelöst werden [3], [7]. Mit Hilfe 
der Warteschlangenmodelle werden die wichtigen Leistungsgrößen, wie die 
Maschinenauslastung, der maximale Durchsatz, die Nacharbeitsraten und die 
Prozessausbeute sowie die Durchlaufzeiten und die Umlaufbestände errechnet. 
Zur Prognose des Arbeitsfortschrittes wurde ein Fluss-Modell entwickelt, das auf 
dem Warteschlangenmodell aufbaut. 



3.5 Web-Reporting und Schnittstellen 

Ein zentraler Gedanke der Integrierten Simulation ist der Online-Zugriff auf alle 
Inputdaten und Simulationsergebnisse. Hierzu wurde ein dynamisches Web- 
Reporting entwickelt, das auf der Basis der in der Datenbank gespeicherten 
Simulationsergebnisse Berichte im HTML-Format erzeugt und über das Intranet 
zur Verfügung stellt. Für die Weiterverarbeitung der Simulationsergebnisse wurde 
auf der Basis von MQ-Series eine Schnittstelle zum Hauptprogrammplanungs- 
system etabliert. Dabei erhält der Planer über eine Filterfunktion die Möglichkeit, 
bestimmte Parameter auszublenden. 



4 Fazit 

Die Erfahrungen aus diesem Projekt zeigen, dass eine Integration der Simulation 
in regelmäßige Planungsabläufe mit einer verteilten Dateneingabe und einem 
zugrundeliegenden Geschäftsprozess möglich ist. So kann die notwendige 
Aktualität der Inputparameter von Simulationsmodellen, die die Fertigungskette 
eines Unternehmens modellieren, sichergestellt werden. 

Der Online-Zugriff auf die Modellparameter wie auf die Simulationsergebnisse 
macht den Planungsprozess für alle Beteiligten transparent. Planung geschieht auf 
diese Weise nicht mehr isoliert in den Planungsabteilungen. Im Gegenteil, auch 
diejenigen Abteilungen, die vornehmlich für die Eingabe der Inputparameter 
verantwortlich sind, können die Planungsergebnisse einsehen und werden somit in 
den Planungsprozess eingebunden. Durch diese Durchgängigkeit wird das 
Verständnis für die Notwendigkeit einer akkuraten Dateneingabe und das 
Vertrauen in die Planungsergebnisse gefördert. 
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Eine weitere Herausforderung stellt die zentrale Hauptprogrammplanung für 
die weltweit verteilten und unterschiedlich komplexen Fertigungsstufen unter 
Einbeziehung der Lieferanten dar. Auch hier ist die Verfügbarkeit von aktuellen 
und akkuraten Inputdaten essentiell. Hier wurde durch die Verbindung mit der 
integrierten Simulation die Konsistenz der Planparameter durch den Zugriff auf 
eine zentrale Planparameter-Datenbank hergestellt. Mit dem Einsatz eines 
einheitlichen Datenmodells werden für alle Fertigungsabschnitte der Supply Chain 
untereinander vergleichbare Inputdaten für die übergeordnete Hauptprogramm- 
planung erzeugt und systemgestützt übermittelt. 

Ein weiterer Vorteil der Kombination der Hauptprogrammplanung mit der 
Simulation ist die Möglichkeit zur Kontrolle der verwendeten Vorlaufzeiten und 
kapazitiven Nebenbedingungen im Simulationsmodell. Über diese Kontrolle, die 
dezentral in den verstreuten Fertigungsstätten durchgeführt wird, erfolgt dann die 
Zusage des Fertigungsmanagements, den vorgegebenen Plan zu erfüllen. Durch 
die engen Zeitvorgaben im Planungsprozess müssen die Simulationsergebnisse in 
recht kurzer Zeit vorliegen. Die entwickelten Warteschlangenmodelle eignen sich 
dafür in besonderer Weise, da alle im Zusammenhang mit der taktischen Planung 
benötigten Leistungsgrößen in sehr kurzer Zeit berechnet werden. Es bleibt dann 
noch genügend Zeit, um verschiedene Simulationsszenarien durchzutesten. 
Außerdem können durch die Weitergabe allein der kritischen Engpässen an die 
Programmplanung redundante Nebenbedingungen des Optimierungsproblems 
eliminiert werden. 
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Zusammenfassung Für die Leistungsanalyse hochautomatisierter Anlagen zur 
Montage elektronischer Baugruppen wurde ein objektorientiertes Simulationssys- 
tem entwickelt, das die zur Bestückung einer Leiterplatte erforderlichen Abläufe 
detailliert unter Berücksichtigung der kinematischen Eigenschaften der jeweiligen 
Bestückungsautomaten abgebildet. Die entwickelten Simulationsbausteine sind für 
generelle Automatenklassen konzipiert und können daher durch einfache Paramet- 
risierungen speziellen Bestückungsautomaten angepasst werden. 



1. Einleitung 

Bei der Herstellung elektronischer Baugruppen dienen Leiterplatten (PCBs, prin- 
ted circuit boards) als Träger für die einzelnen elektronischen Bauelemente. Wäh- 
rend früher bedrahtete Bauelemente verwendet wurden, die in manueller bzw. 
halbautomatischer Arbeitsweise bestückt wurden (siehe [9]), haben sich inzwi- 
schen oberflächenmontierte Bauelemente, sog. surface mount devices (SMDs) 
durchgesetzt, die mit Hilfe von Bestückungsautomaten direkt auf der Oberfläche 
der Leiterplatte aufgesetzt werden. Das Leistungs verhalten von einzelnen Bestü- 
ckungsautomaten oder ganzen Montagelinien kann nur unzulänglich durch Fak- 
toranalysen, Kennlinien oder einfache analytische Modelle erfasst werden. Um ei- 
ne korrekte Abbildung des Leistungsverhaltens unter verschiedenen Rahmenbe- 
dingungen und Szenarien zu gewährleisten, ist eine detaillierte Simulation der 
Maschinenkinematik der Automaten in der Montagelinie erforderlich. 

Am Fachgebiet Produktionsmanagement der TU Berlin wurde mit Unterstüt- 
zung der Deutschen Forschungsgemeinschaft das simulationsgestützte Planungs- 
und Analysewerkzeug EASE (Electronics Assembly Simulation Environment) 
entwickelt (siehe [1], [2], [5], [8]). Geeignet ist das System sowohl für die Aus- 
wahl und anwenderspezifische Modifikation von Bestückungsautomaten als auch 
für die operative Produktionsplanung und -Steuerung. Die Simulationsmodelle in 
EASE zeichnen sich durch eine sehr hohe Modellierungstiefe aus. In E A S E 
werden alle relevanten Maschinenelemente (Bestückungskopf, Arbeitstisch, Bau- 
elementemagazin usw.) einzeln in ihrem Aufbau und ihrer dynamischen Funkti- 
onsweise als Simulationsbausteine modelliert. Darüber hinaus können vollständige 




277 



Montagelinien aus einzelnen Maschinenmodulen zusammengesetzt und weitere 
Elemente wie Siebdruckmaschinen oder Lötofen in das Modell aufgenommen 
werden. 



2. Typen von Bestückungsautomaten 



Moderne Bestückungsautomaten bestehen im wesentlichen aus drei kinematischen 
Elementen: dem Magazin, das die Zuführungen für die verschiedenen Bauelemen- 
tetypen aufnimmt, dem Leiterplattentisch, in den die Leiterplatte während der Be- 
stückung eingespannt ist, sowie einem Transfersystem, das die Bauelemente vom 
Magazin zur Leiterplatte transportiert und den eigentlichen Bestückungs Vorgang 
vornimmt. Die in der Industrie eingesetzten Typen von Bestückungsautomaten un- 
terscheiden sich wesentlich durch ihre Arbeitsweise. In Abb. 1 ist der schemati- 
sche Aufbau der gebräuchlichsten Automatentypen dargestellt. 



Pick& Place- Automat Collw1£Placo- Automat Chin-Shooter 




Abb. 1. Schematischer Aufbau verschiedener Bestückungsautomaten 



Bei Automaten, die nach dem Pick&Place-Prinzip arbeiten, besteht das Trans- 
fersystem aus einem frei beweglichen Roboterarm, der ein einzelnes Bauelement 
aus dem Magazin aufnimmt und es anschließend auf der Leiterplatte aufsetzt. Eine 
Weiterentwicklung dieses Automatenprinzips stellt der Collect&Place-Automat 
dar, bei dem das Transfersystem als Revolver ausgelegt ist, der zuerst nacheinan- 
der mehrere Bauelemente aus dem Magazin aufnimmt und anschließend die gela- 
denen Bauelemente an den vorbestimmten Positionen auf der Leiterplatte absetzt. 
Zentrale Optimierungsprobleme beim Einsatz von Collect&Place- Automaten stel- 
len die Zuordnung der Bauelementetypen zu den Positionen im Magazin des Au- 
tomaten sowie die Bildung von Bestückungstouren unter Beachtung der Kapazität 
des Revolvers dar (vgl. [7]). Einen dritten grundlegenden Automatentypen bilden 
die sog. Chip-Shooter, bei denen das Magazin in x-Richtung und der Bestü- 
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ckungstisch in x- und y-Richtung frei beweglich sind und das Transfersystem als 
Karussell ausgelegt ist, das durch schrittweise Drehbewegung die aufgenommenen 
Bauelemente weitertransportiert und sie schließlich auf der Leiterplatte absetzt. 
Die Besonderheit dieses Automatentypen ist die Positionierung von Magazin und 
Bestückungstisch simultan zur Drehbewegung des Transfersy stems. Leistungsfä- 
hige Algorithmen für die Steuerung dieses Automatentyps finden sich in [4]. 

Die gestiegenen Produktivitätsanforderungen vor allem in der Massenproduk- 
tion von elektronischen Baugruppen haben in den letzten Jahren zu der Entwick- 
lung von modularen Bestückungsautomaten geführt (siehe Abb. 2). Solche Auto- 
maten bestehen aus einer Rei- 



he von Pick&Place- oder Col- 
lect&Place-Modulen, die wie 
bei einer Transferstrasse se- 
quentiell innerhalb des Auto- 
maten angeordnet sind. Die 
einzelnen Module sind durch 
ein Transportsystem (ähnlich 
einem Fließband) miteinander 
verbunden. Die Leiterplatten 
durchlaufen auf dem Trans- 
portsystem den Automaten 
und werden an den jeweiligen 
Modulen mit einer begrenzten 
Anzahl von Bauelementen be- 
stückt. 



Abb. 2. Modularer Bestückungsautomat 



3. Optimierung modularer Bestückungsautomaten 

Grundsätzlich bestehen bei der Konfiguration von Montagesystemen Wahlmög- 
lichkeiten zwischen den einzelnen Automatentypen sowie hinsichtlich der Ausle- 
gung und Aufrüstung der jeweiligen Anlagen. Als Beispiel seien die zuvor erläu- 
terten modularen Bestückungsautomaten betrachtet. Das zentrale Optimierungs- 
problem beim Einsatz dieses Automatentyps ist der Belastungsausgleich zwischen 
den einzelnen Modulen (vgl. [6]). Hierbei folgen wir der sog. unique-setup- 
Strategie, d.h. die Rüstung des Automaten erfolgt im Hinblick auf einen bestimm- 
ten Leiterplattentyp, der in großer Stückzahl hergestellt wird. Diese Rüststrategie 
steht im Gegensatz zur sog. minimum- setup- Strategie, die den Rüstzeitverlust 
zwischen unterschiedlichen, auf derselben Anlage gefertigten Leiterplattentypen 
minimiert (siehe [3], [8], [11]). 

Die Leistungsabstimmung modularer Bestückungsautomaten gemäß der uni- 
que-setup-Strategie entspricht dem klassischen Problem der Fließbandabstimmung 
bei Einproduktproduktion, wobei die Module des Automaten den Arbeitsstationen 
und die einzelnen Bestückungsoperationen den Arbeitselementen der Fließproduk- 
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tion entsprechen. Die wesentlichen Unterschiede bestehen jedoch darin, dass bei 
der Leiterplattenbestückung keine Reihenfolgebedingungen bezüglich der Bestü- 
ckungsoperationen zu beachten sind; dafür muss aber die beschränkte Anzahl an 
Magazinplätzen der einzelnen Module berücksichtigt werden. Eine weitere we- 
sentliche Besonderheit ist der eingeschränkte Zugang eines Moduls auf bestimmte 
Sektoren der Leiterplatte (vgl. Abb. 3). Bei gegebenem Vorschub des Transport- 
systems lässt sich die Einteilung einer Leiterplatte in Sektoren unschwer ermitteln. 
Hieraus folgt gleichzeitig, welche Bestückungspositionen in einem Arbeitstakt 
(Vorschubschritt) an den einzelnen Modulen des Automaten erreichbar sind. 




Anzahl der 
Vorschübe 



Abb. 3. Zulässige Arbeitsbereiche (Sektoren) einer Sequenz von Leiterplatten 

Bei gegebener Einteilung einer Leiterplatte in Sektoren lässt sich das zu lösen- 
de Problem der Leistungsabstimmung als gemischt-ganzzahliges Optimierungs- 
modell wie folgt beschreiben. 

Indizes , Indexmengen 

i e I Bauelemente (Bestückungsoperationen) 

j e J Module 

zeZ Arbeitstakte 

i e I j z Bestückungspositionen, die von Modul j im Arbeitstakt z erreicht 
werden können 
t e T Bauelementtypen 

Parameter 

m Magazinkapazität je Modul (max. Anzahl von Bauelementtypen) 

t(i) Bauelementtyp, der in Operation i bestückt wird 
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Entscheidungsvariablen 



Xij z = 1, falls Bauelement i von Modul j im Arbeitstakt z bestückt wird 

(= 0, sonst) 

y j t = 1, falls Bauelementtyp t im Magazin von Modul j aufgerüstet wird 

(= 0, sonst) 

w z maximale Arbeitslast des Automaten im Arbeitstakt z 


Modellformulierung 
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Die Zielfunktion (1) minimiert in Verbindung mit den Nebenbedingungen (2) die 
gesamte Arbeitslast des Automaten an den einzelnen Modulen. Die beschränkten 
Magazinkapazitäten werden in (3) erfasst. Aufgrund der Nebenbedingungen (4) ist 
eine Bestückungsoperation nur dann erlaubt, wenn auch das betreffende Bauele- 
ment in dem jeweiligen Modul gerüstet ist. Die Nebenbedingungen (5) stellen si- 
cher, dass jede Bestückungsoperation ausgeführt wird. Hinzu kommen die Vari- 
ablendomänen (6) bis (8). 

Zur Lösung dieses komplexen Optimierungsproblems schlagen Grunow et al. 
[6] einen hierarchischen Ansatz vor, bei dem in der ersten Stufe mit Hilfe einer 
Heuristik die Zuordnung der Bauelementtypen zu den Modulen unter Beachtung 
der beschränkten Magazinkapazitäten erfolgt. In der zweiten Stufe wird dann al- 
ternativ mit Hilfe einer Heuristik bzw. eines einfachen binären Optimierungsmo- 
dells der Belastungsausgleich zwischen den Modulen durchgeführt. Wie Verglei- 
che mit einem einfach zu bestimmenden Lower Bound zeigen, wird in einer 
Vielzahl von Fällen die optimale Lösung gefunden. 
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4. Simulationsmodellierung 

Die Simulation bietet die Möglichkeit, die Abläufe innerhalb eines Bestückungs- 
automaten wesentlich genauer als in dem obigen Optimierungsmodell abzubilden 
und darüber hinaus weitere Elemente des Montagesystems und der Anwendungs- 
umgebung in das Modell einzubeziehen. Hierzu wird auf das eingangs erwähnte 
objektorientierte Simulationssystem EASE zurückgegriffen, das mit Hilfe der 
Simulationssoftware eM-Plant und unter Einbindung externer C- und VisualBasic- 
Programme entwickelt wurde. EASE besteht aus drei Grundmodulen, nämlich 
einer Modellbank mit Simulationsbausteinen für verschiedene Klassen von Bestü- 
ckungsautomaten, einer Methodenbank mit Algorithmen zur Produktionsplanung 
und zur Automatensteuerung sowie verschiedenen Schnittstellen für die Einbin- 
dung vorhandener Produktionsdaten. Im Folgenden wird beispielhaft die Simula- 
tionsmodellierung eines modularen Bestückungsautomaten erläutert. 

Das Simulationsmodell ist in zwei Hierarchieebenen gegliedert (vgl. [12]). In 
der oberen wird das Zusammenspiel zwischen den wichtigsten Systemelementen 
des Modells gesteuert. In der unteren Ebene erfolgt die detaillierte Modellierung 
der einzelnen Systemelemente (u.a. Leiterplatte, Portalsystem, Bestückungsköpfe, 
Transportsystem), die mit Steuerungsregeln zum Ablauf der Bestückungsvorgänge 
hinterlegt sind. Abb. 4 zeigt die Objekte des Simulationsmodells im Überblick. 




pr "" ns ^ 



Abb. 4. Objekte des Simulationsmodells für einen modularen Bestückungsautomaten 

In der Simulation werden sowohl die Hauptzeiten (Rüst- und Bestückungszei- 
ten) als auch die Nebenzeiten (Leiterplattentransport, Ein- und Ausspannzeiten, 
Lagejustierung usw.) erfasst. Jede Leiterplatte durchläuft zunächst das Setup, in 
dem die Vorbereitung des Automaten bzw. der Leiterplatte zusammengefasst ist. 
Anschließend wird die Leiterplatte im Portalsystem des Automaten bestückt. Der 
Bestückungsvorgang wird für jedes Bauelement von der Entnahme aus dem Ma- 
gazin, dem Transport zum Bestückungstisch, der Prüfung des Bauelements bis zur 
Platzierung auf der Leiterplatte vollständig abgebildet. Nach dem Bestücken sämt- 
licher Bauelemente verlässt die Leiterplatte das Portalsystem. Für eine spätere 
Auswertung werden die wichtigsten Daten der Simulation aufgezeichnet. Die Ein- 
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bindung externer Optimierungsprogramme (z.B. des im Vorabschnitt erwähnten 
Verfahrens zur Leistungsabstimmung) erfolgt über eine spezifische Schnittstelle. 

Als modularer Bestückungsautomat wurde exemplarisch der Automat FCM 16 
von Philips modelliert. Dieser Automat verfügt über 16 Module mit je einem Pick 
&Place-Bestückungskopf und einem Magazin für maximal sechs Bauelementety- 
pen. Für die numerischen Untersuchungen wurden Daten von neun industriell ge- 
fertigten Leiterplatten verwendet, die in Autoradios und Navigationssystemen zum 
Einsatz kommen. Aus praktischer Sicht besteht ein wichtiges Anwendungsgebiet 
der Simulation darin, die reale Bestückungsleistung eines Automaten in Abhän- 
gigkeit von den Charakteristika der gefertigten Leiterplatten (u.a. Anzahl der Bau- 
elemente sowie der Bauelementtypen) zu bestimmen. Abb. 5 zeigt als ausgewähl- 
tes Simulationsergebnis den Einfluss der Bauelementeanzahl auf die Bestückungs- 
leistung eines modularen Bestückungsautomaten. 



♦ Aufträge lineare Regression 




Bauelementeanzahl der Leiterplatte 



Abb. 5. Bestückungsleistung in Abhängigkeit von der Bauelementeanzahl 



6. Fazit 

Durch die Modellierung der Maschinenelemente sowie durch die Simulation jedes 
einzelnen Bestückungsvorgangs ist es möglich, ein verlässliches Abbild des realen 
Leistungsverhaltens des Produktionssystems unter Anwendung vorgegebener 
Steuerungsprogramme zu erhalten. Die objektorientierte modulare Programmie- 
rung bietet darüber hinaus die Möglichkeit, einzelne Systemelemente ohne größe- 
ren Aufwand zu manipulieren oder auszutauschen. Beispielsweise werden auf Au- 
tomatenebene Analysen der Automatenleistungen für konkrete Leiterplattentypen 
unterstützt. Dabei können auch einzelne Maschinenoperationen analysiert und 
Engpässe einzelner Maschinenelemente aufgezeigt werden. Auf diese Weise wird 
eine detaillierte Analyse des Leistungsverhaltens der Automaten ermöglicht. 
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Für den industriellen Betreiber eines Montagesystems erlaubt die Simulation 
eine konkrete Leistungsanalyse unter den Bedingungen der jeweiligen Anwen- 
dungsumgebungen, die u.a. durch die Produktionsorganisation, das Fertigungs- 
programm und die Rüststrategien geprägt sind. Darüber hinaus können Entschei- 
dungen zur Auswahl geeigneter Automatentypen und der Konfiguration des 
Montagesystems einschließlich der Kapazitätsdimensionierung und der Leistungs- 
abstimmung innerhalb der Montagelinie unterstützt und alternative Verfahren zur 
Planung und Steuerung des Montagesystems und der einzelnen Automaten ver- 
gleichend bewertet werden. 
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Abstract. We investigate a special mixed-discrete bilevel programming problem 
resulting from the task to compute cash-out penalties due to the supply of incorrect 
amounts of natural gas through large gas networks. For easier solution we move the 
discreteness demand from the lower to the upper levels. This clearly changes the 
problem and it is our aim to investigate the relations between both problems. After 
the move, a parametric generalized transportation problem arises in the lower level 
for which the formulation of conditions for the existence of an optimal solution is 
our first task. In the second part of the paper, requirements guaranteeing that an 
optimal solution of the original problem is obtained by solving the modified one as 
well as bounds for the optimal value of the original problem are derived. 



1 Introduction 

Bilevel programming problems are hierarchical optimization problems where 
the set of variables is partitioned between two variables x and y. The values 
of x = x(y) are determined by the follower knowing the selection of the other 
decision maker, the leader. The bilevel problem is the problem of the leader 
who has to determine the best choice of y knowing the reaction x = x(y) of 
the follower on his decisions. To formulate the bilevel optimization problem 
consider the follower’s parametric problem first. Given y 6 Y C R m he has 
to take 

x(y) € &(y) := Argmin {f(x,y) : g(x,y) < 0} , (1) 

X 

i.e. x(y) is an optimal solution of a parametric optimization problem. Now, 
the leader’s problem (or the bilevel optimization problem) is 

min {F(x,y) :x<E&(y), y eY} . (2) 

x,y 

Problems of this type have been investigated in the monographs [1,2]. The 
number of possible applications is large and quickly growing (cf. the anno- 
tated bibliography [3]). Other than for continuous problems, (mixed-) discrete 
bilevel programming has been the topic of rather a small number of papers. 
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Here we consider a special bilevel programming problem where the lower 
level problem (1) is a generalized transportation problem: 



n m n m 

EE CijX-ij ~h ^ ^ dj j_i -h ^ ^ djXfi-\-\ 

i=l j=l i=l j=l 

m 

^ ^ Xij + (1 — q)xi ^ m + 1 = di , i = 1, . . . , w, 
i= 1 

n 

} ^ u ijXij ~b #Wn+l J^n+1,;7 = bj , J — 1, • • • , m, 
i=l 

Xij > 0, i = 1, . . . , n + 1, j = 1, 2, . . . , m 4- 1, 
q G {0, 1} . 



min 

x,q 



( 3 ) 



Here, the coefficients Uij G (0, 1) and the 0-1 Variable q indicates that we 
either have inequalities in the first or in the second block of constraints. This 
is a generalized transportation problem since the coefficients in the constraint 
matrix can be different from zero and one and possible slacks are penalized 
in the objective function. Moreover, the objective function is not linear but 
the absolute value of a linear function. Denote the set of optimal solutions of 
this problem by ^(a, 6), where a = (ai, . . . , a n ) T , b = (&i, . . . , b m ) T . 

The bilevel programming problem reads then as 



n m n m 

E E Ci J x iJ + E d i x i,m+ 1 + E d 2 j x n+ hj -+ min 

‘ ^ ‘ ^ x.q.a.b 

i = 1 j=l i=l j=l 

(x,q) T e*(a,b), (a,b) T eY (4) 

where Y is a fixed set, Y C x R™. 

Problem (3), (4) is a reformulation of a problem for minimizing the cash- 
out penalties of a natural gas shipping company [4,7,8]. 

Bilevel programming problems are ,/VP-hard [5], and discrete bilevel pro- 
gramming problems are even harder so solve. This is especially true if the 
discreteness demand is located in the lower level problem [9]. Hence, we feel 
that it may be advantageous to shift the integrality demand from the lower 
to the upper levels. This, of course, changes the problem, but it has two 
implications. First, since there is only one 0-1 variable in the problem, this 
is reduced to the solution of two bilevel programming problems, the better 
solution of the two is taken as result of the problem. Next, to solve the re- 
sulting two linear bilevel programming problems we can e.g. use an idea in 
[10] reducing both problems to quadratic optimization problems involving a 
penalty term in the objective function. 
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2 The Subproblems 

If the discreteness demand is shifted into the upper level problem, the lower 
level ones (3) reduce to problems of minimizing the absolute value of a linear 
function on a polyhedron. If all the values on the right-hand side are finite 
numbers, the polyhedron is bounded. Hence, this problem has an optimal so- 
lution whenever its feasible set is nonempty. We give conditions guaranteeing 
nonemptiness of this set. 

Consider the lower level problem (3) with q = 1 (the case with q = 0 can 
be dealt with similarly) and take an arbitrary linear objective function for 
convenience: 

n m m 

53 53 Ci i Xi i + 13 d2 j x n+h] min 

i = 1 j = 1 j = 1 X,Q 

m 

^ ^ X%j — 5 2 — 1 , . . . , 72 -(- 1 ? 

3 = 1 
n 

^ ^ 'U'ijXij -f- U n + ljX n +ij — bj, j — 1, . . . , 772, (5) 

i = 1 

Xij > 0, i = 1 , . . . , n '+ 1 , j = 1 , 2 ,..., 777, . 

Note that we have added one constraint with unknown (to be fixed later) but 
nonnegative right-hand side a n+ i to give the model a more familiar formu- 
lation. If this problem has a feasible solution, then this is also valid for the 
original one. Now, we use an idea originating from [6] to transform the prob- 
lem. Take any set of m 4* (n + 1) — 1 = m + n basic variables (i,j) G U. 
Then, if we take s i = 1, the system of equations 

Si - tjUij = 0, V (ij) G U (6) 

has a unique solution ( s , t) with Si > 0, tj > 0 for all 2, j. Using this solution, 
the generalized transportation problem can be transformed into 

n m m 

53 53 Ci i Xi i + 53 dj x n+i,3 -*• min 

i = 1 j= 1 j=l X ’ q 

m 

^ ^ S%Xij — SiCLi, % — 1, . . . , 72 -j- 1, 

3 = 1 

U t- t- 

^ ^ 2 Hj SiXij -j- Un+ij S n - j-iX n _|_i ? j = tjbj , j — 1, ... 5 772, (7) 

i=l ^ ^n+1 

Xij > 0, i = 1, . . . , 72 + 1, j = 1, 2, . . . , 772 . 

This problem arises if each equation in the first set is multiplied by s* and 
each one in the second system by tj. But now, the coefficients in the second 




287 



set of equations reduce to one for (i,j) £ U. By simply summing up the 
constraints of problem (7) and using that Xij = 0 for (i,j) U we get 

Theorem 1. If the generalized transportation problem (5) with q = 1 has 
a feasible solution then there is a basic feasible solution with = 0 for 
(hj) U such that 

n+1 ra 

^2s i a i = ^2t j b i ( 8 ) 

i-1 j= 1 

for the solution s,t of (6). 

Equation (8) shows that a n+ i has to be taken as 

m n 

^n+l^n+1 ~ ^ ^ tj bj ^ ^ SiOi 

j = 1 i = 1 

and that a necessary condition for solvability of this problem is a n + 1 > 0. Not 
every set of basic variables corresponds to feasible solutions of the generalized 
transportation problem (5). To find a condition characterizing correct basic 
solutions, consider a subset I C {l,...,n + 1} and the set N(I) := {j : 
(i,j) e U for some i £ /}. Then, for a feasible solution of the generalized 
transportation problem we have 

s i a i = y SiXij < Uij-^- s^Xij = y^ tjbj (9) 

iei iei (ij)eu jeN(i) (ij)eu * 

due to = 0 for (i,j) £ U. Here, the inequality is implied by {(z, j) £ U : 
iei} C {( ij ) eU : j £ N(I)} and Uijtj/si = 1 for (i,j) £ U. Also, using 
the set M{ J) := {i : (i, j) £ U for some j £ J} for J C { 1 , . . . , ra} we get 
the similar inequality 

Siüi= H Yh niff s' = • (10) 

<€Af(j) ieM(j) (i,j)eu jeJ(ij)eu z jeJ 

Theorem 2. Consider the generalized transportation problem (5) with q = 1. 
Then a set of basic variables corresponds to a feasible solution if and only 
if the conditions (8) together with (9) and (10) are satisfied for all subsets 
I C {1, . . . , n + 1} and J C {1, . . . , ra}. 

To prove this theorem use a method like the north-west corner rule for com- 
puting a starting solution for the transportation problem. Such methods fix 
the basic variables one after the other such that in any step one of the equa- 
tions in the definition of the problem (7) is satisfied. Then, in the next step, 
a basic variable x^ is to be determined with 



(i,j) e {( i,j ) eU :je N(l)} \ {( i,j ) eU-.iel} 
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respectively 



(ij) G eU :ie M(J)} \ {( i,j ) elf :j e J} 

for which is enough space by the assumptions of the theorem. Here, U denotes 
the index set of basic variables, and I and J are the index sets of the equations 
being already satisfied in that step. 

To derive another result consider the variables £n+ij in the problem (5) 
as being slack variables. Then, to investigate solvability of the lower level 
problems we can investigate the two problems 

n m 

i= 1 j= 1 
m 

X ^ %ij = Qii i — 1, . . • , n., 

3 = 1 
n 

XX U i3 X i3 ^ b P j = 1, • • • , m, (11) 

i= 1 

Xij > 0, i = 1, . . . , n, j = 1, 2, . . . , m 



and 



n m 

XI XX Ci 3 Xi 3 
i= 1 j = 1 

m 



min 

x,q 



E 






i = l,...,n, 



j=i 



n 

E WijZy = bj, j = 1, . . . , to, (12) 

i = 1 

> 0, i = 1, . . . , n, j = 1, 2, . . . , m . 

Theorem 3. For am/ natural numbers n,m and vectors a = (ai, . . . , a n ) T , 
b = (&i, . . . , 6 m ) T , with ai > 0, i = 1, . . . , n, bj > 0,j = 1, . . . , m least one 
of the problems (11) and (12) has a feasible solution. 



Proof To prove our assertion, we use the modified North-West Corner Rule 
in the following form. 



0: Set k = 0, i k = 1, j k = 1. 

1: Put 

x — { aik ’ ^ Uik ,Jfc aik — ^ k ’ 

Zfc ,3k 1 b Jk / u i k ,jk , otherwise. 

2: If ifc < n then set 



Mfc + 1, If u ik,jk a ik — b jk > 

\ ifc, otherwise. 
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If %k = n and Ui k j k di k < bj k , then set K — k and stop. If ik+i = ik + 1 
goto Step 3. 

Symmetrically, if jk < m , put 

A — / ^ u ik,jk a ik ^ 

J + otherwise. 

At last, if jfc = m and Ui ki j k di k > bj k , then set K = k and stop. 

3: Now we update the parameters: 

a i k := &i k ~ x ikjk'i bjk bj k — Ui k j k Xi k j k . 

If di = 0 for all i = 1, . . . , n, or 6^- = 0 for each j — 1, . . . , m, then set 
K = k and stop. Otherwise, set k := k + 1 and return to Step 1. 

Let the algorithm stop in Step 3. Then by construction, either a = 0 which 

m n 

means that we have x ij = a i> i = b • • • > n or b = 0 implying ^ UijXij — 

j=l i= 1 

bj , j = 1, . . . ,m. Since the other system of inequalities is also satisfied, we 
obtain non-emptiness of the feasible set of either problem (11) or (12). If the 

m 

algorithm stops in Step 2 then either %k = n and x ij = a ii * — 1? • • • ? n 

3=1 

n 

or Jk = m and J2 u ij x ij — bj, j = 1 ,...,m. In both cases, the other 

Z=1 

system of inequalities is also satisfied by construction. This again implies 
non-emptiness of the feasible set of either problem (11) or (12). The theorem 
is proved completely. 



3 Relation Between the Bilevel Problems 



As mentioned in the Introduction, we replaced problem (3), (4) by 



X] 53 + 5Z d i x i,rn + 1 + 



*=1 j=l 



IjXn+ij mm 

J x,q,a,b 



(x, q) T e S', (a, 6), (a, b) T eY, «€{0,1} (13) 

where \P q (d,b) denotes the set of optimal solutions of problem (3) with q 
being fixed to q = 0 or q = 1. In doing so we cannot expect to obtain optimal 
solutions for problem (3), (4) in any case. 

Theorem 4. Let ( x°,d°,b °) be d locdlly optimdl solution for problem 



mjn 1 53 X] Ci i Xi 3 + 53 d i X i <™+ 1 : ( x > «) T e ^«( a > b )> (°> b ) T e Y f ( 14 ) 

I i = 1 j=l i= 1 I 
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with q = 0 and objective function value 

n m n 

Z ° = IZIT Ci i X ij + d i x lm + 1 

2=1 j = l 2=1 

and let x 1 G #i(a°,&°) with 

n m m 

zl = c ^ x h + £ 44 + 1 , ^ • 

2=1 J=1 j — 1 

If0<z°<z 1 , then (x°,a°,& 0 ) zs a local optimal solution of problem (3), 

( 4 ). 

The proof of this theorem mainly uses continuity of the optimal function value 
of right-hand side perturbed linear optimization problems guaranteeing that 
the function value of feasible solutions for the subproblem with q = 1 for 
parameter values being near to (a 0 , b°) can never be lower then z°. Hence the 
sequence of inequalities 0 < z° < z 1 implies that x° G ^(a 0 , 6°) is feasible for 
the problem (3), (4) and this persists in a neighborhood of (a 0 , b°). 

There are some more cases which can be treated similarly: 

Remark 1. 1. (x°, a 0 ,b°) is locally optimal for problem (14) with q — 0 and 

0 > z° > z 1 , 

2. (x 1 , a 1 , b 1 ) is locally optimal for problem (14) with q = 1 and 0 > z 1 > z°, 
and 

3. (x 1 ^ 1 ,^ 1 ) is again locally optimal for problem (14) with q = 1 and 
0 < z 1 < z°. 

It is not too difficult to see that an optimal solution of problem (3) is either 
in &o (a,b) or in &i(a,b). Hence, 

&(a, b) C % (a, b) U #i(a, b) 



and thus 

{(x, a, b) : x G !^(a, b)} C {(x, a, b) : x G (a,b)}U {(x, a, b) : x G #i(a, b)} . 

Now, since the feasible set in problem (3), (4) is equal to the set on the left- 
hand side and the feasible set of the really solved one is equal to the larger 
set on the right-hand side of this inclusion we get 

Theorem 5. min z q < z* < max z q where z q denotes the optimal func- 
qe { 0 , 1 } <?g{o,i} 

tion value of (14) and z* is the optimal value of problem (3), ( 4 )• 
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Abstract. In [3] (JP-problems with strict convex objective functions / were in- 
vestigated in order to detect constraints that are not active at the optimal point 
x*. It turned out, that simple calculations performed in parallel with an QP-solver 
allow a decision to delete restrictions from the problem. This might shrink down 
the problem size during the optimization procedure. These sufficient conditions for 
non activity could be generalized to the positive semi-definite case (see [4]). 

In the present paper it is shown that the techniques presented in [3] allow to get ad- 
ditional possibilities for a deletion of superfluous constraints. For this, the optimal 
point xq of the unrestricted QP-problem is suitably disturbed within some special 
set M(f(x*). This set is unknown in advance but a subset A(x o) can algorithmically 
be generated. It is also proved, that x * is a limit point in A(x o). 



1 Introduction 



We consider the strictly convex quadratic programming problem QP 
min x€ s f{x) = \{x - xo) t C{x - x 0 ) 



s.t. S = {x | a\x <bi,i = 1, 2, ..., m } . 



C is a symmetric, positive definite ( n x n) matrix and d E R n . We assume 
that the set S C R n of feasible points is non-empty and that all a* ^ 0. Let 
x* denote the optimal solution of QP. 

We will say that the i — th restriction is superfluous for QP, if it is non-active 
at x*, i.e. a\x* < bi. 

For an arbitrary point y E R n define the following structural quantities and 
sets that appear in connection with QP: 



n(y) 


= a\y - b u i 


Qij 


= a^C a,j, \ 


J-(y ) 


= {* 1 ri{y) < 0} 


J + (y) 


= {* 1 n(y) > 0} 



= l,2,...,ra 
i,j = l,2,...,m 



The aim of the paper is, to use these quantities for detecting superfluous 
restrictions for QP. 
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2 Characterizing Active and Superfluous Constraints 

Consider an arbitrary positive definite, symmetric (n x n) matrix C. To- 
gether with y and the a^s it induces quantities = a\C~ 1 aj and a function 
F(x, y) = |(x — yYC(x — y). F(x, y). They provide a complete characteriza- 
tion of superfluous constraints for QP: 

Proposition 1. The i — th restriction is superfluous for QP if and only if 
there is y G R n , a positive definite , symmetric matrix C and a > 0, satisfying 
the conditions 

a. ) F(x*,y) < a 

b. ) i G J-(y) and r 2 (y) > 2 aq ü . 

Proof: " =^": Choose y = x*,C = J n , ä < \ • (bi — a\x*) 2 \\ai\\~ 2 . With 
these settings conditions a.) and b.) trivially hold. 

" 4=": Let x^* be the minimizer of F(x, y) on the affine space 
Hi := {x | a\x = bi}. 

... _ i ~ _i 

Computation yields x^* = y + A q u 2 C~ 1 ai , where A = —ri(y)q u 2 . Since 
i G J-(y ), A > 0. Further on F(x^*,y) = ^A 2 = ^^(y)#^ 1 . Hence, for an 
arbitrary point x e S with F(x, y) < a we get F(x, y) < F(x^*,y). For 
these points Taylor formula F(x, y) = F(x^*, y) + V^F |* = ~ (i) * (x — x^*) -f- 
\(x — x^) t C(x — fW*) implies V X F |* =£(i) * (x — x^*) < 0. 

This leads to A q ii 2 a t i (x — < 0, i.e. a!-(x — xW*) < 0. Since x G S was 

arbitrarily chosen, strict inequality must hold also at x*, i.e. a*x* < bi. ■ 

For an algorithmic purpose only the " <=" part is of interest but, unfor- 
tunately, the proposition is not constructive in this regard. It gives no hints 
how to get y, C and a. Moreover, x* is unknown in advance. 

In order to exploit it anyhow for the detection of superfluous restrictions we 
will fix C by the original matrix C but allow y and a to vary. The variation 
of y can be considered as alteration of the point xo , the optimal point of the 
unrestricted QF-problem. The special case, that y — xq is fixed, was investi- 
gated in [3]. 

For the values of a we allow a variation within the interval [/(x*), oo[, i.e. we 
will generally suppose that a is given in such a way that /(x*) < a. From a 
practical point of view, the knowledge of such a is not a crucial restriction. 
Standard QP-solution procedures that are of interior point type successively 
produce a decreasing sequence of such upper bounds (e.g. see [1]), [2]. 

As a function of y, F(x*, y) |(x* — y) t C(x* — y) induces convex level sets 
M(a) := (y|F(x*,y) < a} for a > 0. These sets are monotonous in a > 0 
with respect to set-inclusion. 

Note, that for a > /(x*) xo e M (a). 

Superfluous restrictions can now be characterized by considering only points 
y G M(a), i.e. varying xq within M(a). 
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Proposition 2. The i — th restriction is superfluous for QP if and only if 
there is y G M(a) satisfying i G J-(y ) and rf(y) > 2 aqu . 

Proof: " =>". Let r*(x*) < 0. Then there is x* := x* — r?(x*)q~ i 1 C~ 1 ai s.t. 

a*x* = 6*. Obviously, F(x*,x*) = . Now, consider the case F(x*,x*) < 

a. Define y := x * + Ag^C” 1 ^, where A is arbitrarily taken from the interval 

For such y we get F{x*,y) = ^A 2 ^ 1 < |r?(x*)( F(a .? a;?) )gr 1 = a, i.e. y € 
M(a). Moreover, = a*x* + A and rfly) = r*(x*) + A. Since A < 0, we get 
i G J_(y) and r?(y) = (r* + A) 2 > (r<(x*) + “ !) 2 = 

I.e. (ii.) is satisfied. This is also the case if a < jF(x*,x*), by simply setting 
y :=x*. 

n f 0 jj 0WS immediately by Prop. 1. ■ 

Since a is an arbitrary upper bound for the optimal value of QP we 
immediately have 

Corollary 1. The i — th restriction is superfluous for QP if and only if there 
is y e M(f(x*)) satisfying i € J-(y) and r?(y) > 2f{x*)qu . 

We now also get a complete characterization of active constraints: 

Proposition 3. The i — th restriction is active at x* if and only if the sets 
Si,a(y) •= {%\ a \ x — &i} H {x|F(x, y) < a} are nonempty for all y G M(a). 
Proof: " =>". Obviously x* G Si jOC (y) for all y G M(a). " <=". For y G M(o), 
let z*(y), be a point satisfying a\z*(y) = bi and F(y,z*(y)) < a.Assuming 
that the i — th constraint is non-active at x*, then, by Prop. 2, there is 
Vo € M{a) s.t. i € J_(y 0 ) and rf(y 0 ) > 2 aqu. But rf(y 0 ) = 2F(y 0 ,z*(y Q ))q H , 
i.e. F(yo 1 z*(yo)) > a, a contradiction. ■ 

3 Sufficient Conditions for Superfluous Constraints 

At an arbitrary point y G M(a) all restrictions i , satisfying ßi(y) := F(y , z*(y)) 

= ^^ 7 - > ol are identified to be superfluous for QP. To get additional non- 
active constraints within the remaining ones consider two nonlinear optimiza- 
tion problems at y: min^s. djX and max^#. a*x. Let their optimal 
values be denoted by rf ^a^y) and fy**(a, 2 /), respectively. 

Proposition 4. 

*• T j,i(<x,y)= at jy-Qii 1 n{y)Qij + (2aq u - ri{y) 2 )i {quqjj - g?-)*] . 

H- T**{a,y) = a)y - q^ 1 ri{y)q tJ - ( 2 aq u - r?(y))* {quqjj - ??•)'] • 

Hi. If Tj ^a^y) > bj , then the i — th restriction is superfluous for QP 
iv. Ifrf*(a,y) < bj , then either the i — th or the j — th restriction is super- 
fluous for QP 
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Proof: (i.) Note, that both optimization problems have solutions since QP 
is assumed to be solvable and ßi(y) < a. The proofs of i. and ii. are then 
based on the same construction used in [3] , up to exchanging xq and y on the 
one hand and f(x) and F(y , x) on the other. 

(ii.) The condition Tj ^a^y) > bj implies, that djX > T?i(a, y) > bj for every 
point x G S^ a (y),. Hence, x * ^ S^ a (y). But x* G {x\F(x, y) < a}. Therefore, 
we conclude that a\x* < bi. 

iv.) The assumption a\x * = bi would imply djX * < r?*(a,y) < bj. I.e., both 
restrictions cannot be active at x* simultaneously. ■ 

If di and a,j are linearly independent (i.e. qu • qjj > q?j), the function 
T j,i( a i v) 1S strictly decreasing on [ßi(y), oo[, with rj^(a, y) ■— > — oo if a — > oo. 
The function r?* (a, y) is strictly increasing on [ßi{y), oo[ and rj**(a, y) — > +oo 
if a — > oo. 

In this case we get 

Corollary 2. Fory e M(a) let a* { j (y) := (2qu)- 1 [r‘f(y)+(r j (y)qi i -ri(y)q ij ) 2 
{ qaqjj — q%)~ 1 }- Assume that a < a* j{y). 

i. Ifrj(y)qu — Vi(y)qij > 0, then the % — th restriction is non-dctive dt x * . 

ii. Ifrj(y)qu — ri(y)qij < 0 ; then either the i — th or the j — th restriction is 
non-dctive at x * 

Proof: An easy calculation shows, that the equation r^(a, y) = bj is solved 
by alj(y) if and only if rj(y)qu - ri(y)qij > 0. Similar, r^(a,y) = bj has 
the solution a*j(y) if and only if rj(y)qa — ri(y)qij < 0. Now, with the last 
proposition we get (i.) and (ii.), respectively. ■ 

Since condition i. and ii. of corollary 2 exclude each other they induce a 
partition of M{a) = M + (a)UM_(a), where M+(a) {y G M(a)\rj(y)qu — 
n(y)qij > 0} and M_(a) := {y G M(a)\r j (y)q ii - r l (y)q lj < 0}. Hence, 
choosing some y G M(a) and checking the condition a < a* j(y), we can 
either eliminate all those restrictions satisfying i. or, if ii. is satisfied, at least 
one of the constraints i and j will be superfluous at x*. So, not both can 
appear in an active set at x*. We will put them to some watch list for a 
possible later decision which of them can be omitted. 

In the opposite case di and dj are linearly dependent (i.e. qa • qjj = q?j) and 
every point in Si iOL (y) is an optimal solution with optimal value y) = 

Tj,i( a >y ) = a jV - <iü lr i(y)Qij • 

In this case we have 

Corollary 3. If Tj *(y) — bj, then at least one of the restrictions i or j is 
not necessary for the determination of x* . If q%j < 0, then both restrictions 
are active at x* . 

Proof: The intersection of the two affine half-spaces {x\a\x < bi} and 
{x\djX < bj} either describe {x\a\x < min{^, or {x| — < 

afa < bi}. The first case occurs if qij > 0. In this case one of the half-spaces 
is contained in the other, so that least one of the corresponding constraints 
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is superfluous for QP. In the second case qij < 0. For every x G S^ a (y) we 
get bj = Tj^a.y) < a^x < r?*(a,y) = bj , i.e. x G Sj iOL (y). This implies 

bi = — *- e * constraints must be active at x*. ■ 

If we use a QP— solver that produces a decreasing sequence of upper 
bounds a, all the conditions suggest to look for ’’large values ” of ßi(y), Oi*j(y) 
. As larger these values are, as earlier superfluous constraints can be detected. 
Largest values for these quantities can be found on the boundary of M(a), 
if diiCbj are linearly independent: 



Lemma 1. (z.) The point z * := argmax ye M(a)ßi(y) is a boundary point of 
M(a). 

(ii.) If M+{a) ^ 0, then y* argmax ye M + ( a ) a ij{y) is a boundary point of 
M{a). If M- (a) ^ 0, then y** := CL^gmax ye M-(a) a ij{y) has this property. 
Proof: ( i .) Follows by simple convexity arguments. 

{ii.) Consider y* := nrgmax ye M + (a) a ij{y) • We distinguish two cases. 

First, we assume that rj{y*) = qf^qijV^y*). In this case a*j(y*) = ßi(y*) = 
a > 0, as in (i.). 

In the second case, i.e. r^(y*) < Q^qijr^y*), there is a neighborhood U{y*) 



of y*, s.t. all y G U(y*) solve r*^(a,y) = bj. 

Now, assume, that F{x* ,y*) < a. Since a*j(y) is continuously differentiable 



on U(y*),we get Va* (y*) = 0, i.e. 0 = a*[ 






\rj{y*)qu-ri{y*)qij 



We conclude 77 (y*) = 77 (y*) = 0, contradicting 77 (y*) < 






4 Constructing Points in M(a). 

Although propositions 2 and 3 completely characterize the set of active and 
non-active constraints, the set M(a) is not explicitly given, since x* is un- 
known in advance. Nevertheless, there is an algorithmic scheme that allows 
to construct at least subsets of M (a) . 

Proposition 5 . Let y G M(a) and k G J + (y). For 7 > 0 let y( 7) := y — 7 • 

nM.C-W. 

(i.) Ifje [ 0 , 2 ], then 2/(7) € M(a). 

(ii.) If 7 e]l,2], then k e J-(y( 7)). 

Proof: (i.) F(x*,y( 7)) = ±(x* - y^fCix* - 2/(7)) 

= - y)*C(x* -y) + 1 .rj£&{x*- y)*a k + i 7 2 • [^] 

= U X * ~ y) tc ( x * - y) + 7 • - y)*afc + • y*fc(y)]- 

But now, 0 < 7 r fe (y) = 7 ( 4 y - b k ) < 7 (a|y - a|x*) < 2 ( 4 ?/ - 4 «*)- 
Hence (x* — 2/) t afc + • ^(y) < 0. This implies F(x*,y( 7)) < a. 

(ü.) follows, since r k (y( 7)) = (1 - l)r k {y). ■ 
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Since a > /(#*) and xq g M(/(x*)), the proposition suggests a procedure 
to exhaust the unknown set M(a). It will produce a set of points, say A(x o). 
Each y G A(xo) then might serve as a ’’checkpoint” to detect superfluous 
restrictions for QP. 

Procedure A(x 0 ): 

Step 0: Set yo := xo and j := 0 

Step 1: Choose k G {C _1 afc|l < k < m, fc G «/+(%•)} 

arbitrarily. 

Choose G [0, 2] arbitrarily. 

Compute new iterate 

Vj+i ■■= Vj - 7 j ■ ■ C "W 

Step 2: If G 5 , Stop. 

Otherwise, set j := j + 1 and go to Step 1 
Different points yj+ 1 can be computed by choosing different k G J+{yj) 
or by the different choice of 7 j. The construction of points yj+± obviously 
does not depend on the upper bound a, i.e. all that points are all elements 
of the (unknown) set M(f(x*)). Instead of looking for best possible points 
z*,y*,y** o n the boundary of M(/(x*)), the values of ßi(y) and a*j{y) can 
successively be improved within A(x 0). Such an improvement might be done 
by moving from y to y( 2). For the sake of abbreviation, let us define additional 
structural quantities c ijk := qj k qu ~ Qikqij and b ijk := Cij k (quqjj - qij 2 ) 



Proposition 6. Let y G A(xo),i G {l,2,...,m} and y( 7 ) \—y — 7 • • 

C~ l a k for some k G J+(y) and 7 > 0. Let qi k ^ 0. 

(i) There is 7 €] 0 , 2 ] such that ßi(y(j)) > ßi(y) if and only if < 1- 

In this case ßi(y( 7 )) is maximized at 7 = 2 . 

(u.) There is 7 G]0,2] such that ct*j(y( 7 )) > a*j(y), if and only if 

< L /n this case maximized at 7 = 2. 

Proof: (*.) Obviously, r?(y( 7 ) = rf(y) - 2^n(y)r k (y)^ + l 2 r k {y){^) 2 ■ 
Hence for some 7 G [0,2] we have, ßi(y(yy)) > ßi(y) if and only if 2 > 7 > 

2 r ^k{y)Qik ' ^ nce r ? (2/(7) is strictly increasing for 7 > y^yy^y the best possible 
value is attained at 70 = 2. 

(ii.) For A G R consider the function a*j(y( A)) := ( 2 q i i)- 1 [r‘-(y(\))+(rj(y(\))q i i- 
r i(yW)qij ) 2 ' (quqjj - qij)- 1 ], where y(X) = y — \-?-j^-C~ 1 a k . It is a convex 
function and attains its (global) minimal point at A* = 77^) ( )• 

By monotonicity of the function a* j(y( A)), we get a*j(y(\)) < a*^(y( 2))for 
all A g]0, 2 ], if and only if A* < 1. 

In the opposite case, i.e. A* > 1, then a*j(y( A)) < a*j(y( 0 ) for all A G [0,2]. 



Points y G A(xo) might also provide lower bounds on the optimal value 

of QP. 
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Proposition 7 . Let y G M(/(x*)),i G J+(t/). 

(i.)ßi(y)<F(x*,y)<f(x*). 

(ii.) If there is a such that rjF(a, 2/) > bj for some j ^ J+(2/), £Aen a < /(x*). 
Proof: i. /(x*) = F(x 0 ,x*) > F{y,x*) > min ze{x \ a t x=a t x * } F(y,z) 

> min ze{xla t x=hi} F(y , 2?) = ft(2/). 

n. Obviously, there is A G [ 0 , 1 [, Xi = \y + (1 — A)x* G M(/(x*)) with 
a\xi = bi. Since j £ J+(2/), a*#* < bj. The assumption /(x*) < ä yields 
F{y,Xi) < F(y,x*) < F(x 0 ,x*) = /(x*) < ä, i.e. x* G Si 9 & (y). But this 
implies rjF(ä, y) <bj, a contradiction. ■ 

Last, but not least we will show, that the optimal point x * for QP is a 
limit point of A(xq). We first prove 

Lemma 2. Let x* be the optimizer ofmin xe s F(x, y) and denote by I ac t the 
set of active constraints at x* . If y £ S then I ac t FI J+(y) 7^ 0 . 

Proof: Assume the contrary, i.e. a^y < bj for all j G I ac t • Consider points 
x(a) := ay + (1 — <j)x*,<t G [ 0 , 1 ]. Choose i G {l, 2 ,...,m}. If i G I ac ti 
a\x(a) < bi , for all <7 G [ 0 , 1 ]. The same is true, if 2 ^ /act? but a\y < bi. 

The last case that can happen is, that i satisfies a\y > bi but a\x* < bi. 
Denote by I the set of those constraints. For each i G I there is Gi G] 0 , 1 [ 
with a\x{a) < bi for all a G [0$, 1 ]. Let a * := max^j Gi. Obviously, x(a*) G S. 
But 0 < a* < 1, implying that F(x(a*),y) < F(x*,y)), contradicting the 
optimality of x*. ■ 

Proposition 8. x* is a limit point of A(x 0) 

Proof: First note, that if the optimal point x* of QP is also optimal for 
the problem min^s F(x, 2/), then there are multipliers A* = A i(y) > 0 
such that V x F(x,y)\ x * = - ^ 2 ie i act and J 2 ie i act K(a\x* - bi) = 0 . 
I.e. x* = y - Ysieiact A • If V £ #? lemma 2 gives J oc * n J+(y) ^ 0. 
Moreover, there is at least one constraint, say k G I ac t Fl J+(2/), such that 
Afc > 0 . This must be true, since otherwise 0 < (x* — y) t C(x* — y) = 

-Eie/ act A i a l( x * ~ V) = -E<e/ac»nJ_ A *( 6 * “ a \v) < 0, would produce a 
contradiction. 

Now, consider an arbitrary point yj G M(a) \ S such that x* minimizes 
F(yj,x) on S. By lemma 1 , there is k G /+(%) Fl I ac t with A& > 0 . Set 
Cj := min{ , 2 } and chose 7^ G [ 0 ,c^] arbitrarily. Define 2/^+1 

Vj ~ A fe(%+i) := X k(Vj) ~ A *(^+i) := A * for * ^ 

The point 2/^+1 together with the multipliers A* (2/^+1) > 0 then satisfy C(x* — 

Vj+ 1) = - Ei€{l,2,...,m} x i(yj+i)<H, and Ej € {l,2,...,m} x i(yj+i)( a iX* -bi) = 0. 

I.e. x* is also the optimizer of the problem minxes F(x, 2/j+i). Obviously, 
2/7+1 G A(yj). If 2/j+i G 5 , then F(x, 2/7+1) is minimized on S by 2/j+i, i.e. 
yj+i = x*. In the opposite case 2/7+1 ^ S and the above construction can be 
repeated using 2/ J+ i instead of yj. 

Now, starting with 2/1 := xo this procedure will either terminate after a finite 
number N of steps at a feasible point y n = x* G A(xo), or it will produce 
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an infinite sequence (yj)j= 1,2,..., C M(a),yj G A(xo) of non-feasible points. 
Let D be the set of all limit points that can be obtained by the above 
construction method, i.e the set of points ?/, for which there is a sequence 
{yj)j=i, constructed in the above way and a subset A C {1,2, ...} such 
that limjzjL yj = y. 

Note, that the related multipliers A %{yj),j G A then induce limit points 
A^. For fixed i the sequence (A i(yj))j=i, 2 ,... is monotonously decreasing with 
greatest lower bound Ä * > 0. Using the same arguments as above, x * is 
the optimizer for min x es F(x,y)- For the case y G S this again leads to 
x* = y G D C cl (A). Hence, it remains to show, that D fl S ^ 0. 

For this, suppose D fl S = 0. Since D is closed and D C M(a), the function 
F(x*,y) attains its minimum at some y G D. I.e. 0 < F(x*,y) < F(x*, y) for 
all y G D. Since y £ 5, by lemma 2 there is k G J+ (y) D I ac t with Ä k > 0. 
Moreover, there is jo such that rk{yj) > > 0 for all j > jo, j G A . On 

the other hand rk{yj) < R for some R > 0. 

Now, let e > 0 be chosen in such a way, that 0 < e < mm{2, Afc ^ fcfc }. 

Then there is j\ such that for all j > ji,j G A the inequality F(x*,yj) < 
F(x*,y) 4- f holds. Now, chose 7 > 0, satisfying mm{2, } > 7 > 

fix j > max{io, ji},j € A and set y:=y j -'y- ■ C _1 a fe . 

Obviously, 7 < ^ , i-e. y e D. With F(x*,y) = - 

e ninlf < - I < F(x*,y) - f + § = F(x*,y) - f, we then get the 

contradiction, that y is a minimizer of F(x*,x) on D. ■ 
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Abstract. A comparison of two direct multiple shooting approaches for the solu- 
tion of chemical optimization problems with DAE models of index one is presented. 
Differences are explained in terms of the underlying reduced SQP methods. The 
application to optimal control of a distillation column is used to illustrate the re- 
spective advantages. 



1 Introduction 

Optimal design and operation of complex chemical processes are challenging 
tasks for mathematical optimization tools. Direct simultaneous approaches 
have proven to be good for optimization problems with large, sparse DAE 
process models of index one. Especially discretizing the dynamic model by 
the multiple shooting technique allows the use of existing advanced, fully 
adaptive DAE solvers. In order to cope with inconsistent algebraic start 
values relaxation techniques can be used which allow the use of infeasible 
SQP approaches for all state variables. In the following two direct multiple 
shooting approaches for the solution of optimal control problems with large, 
sparse DAE process models are presented. They differ in the type of reduc- 
tion technique in the SQP method. The first one projects the structured NLP 
problem onto the reduced space of differential variables plus control param- 
eters, using the fact that the algebraic variables are uniquely determined by 
the consistency conditions due to the index one assumption. The second one 
additionally uses initial conditions and continuity conditions for projection 
onto the reduced space of control parameters. In both cases it is demonstrated 
that the expensive calculation of the full set of differential state derivatives 
can be avoided. Instead it suffices to compute only a reduced number of di- 
rectional derivatives. The approaches are compared in terms of the number 
of directional derivatives. In order to calculate the sparse model Jacobians 
an algorithmic differentiation tool is used in combination with seed matrix 
compression. The sparsity of the model Jacobians is exploited in the DAE 
solver and directional differential state derivatives are calculated using the 
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principle of Internal Numerical Differentiation (IND). As an application we 
present the optimal control of a distillation column for separation of a binary 
mixture. Results are presented which compare the computing times for both 
approaches. 



2 Problem Formulation 



Many dynamic process optimization problems in chemical engineering can be 
expressed as multistage optimal control problems in DAE. Throughout this 
paper, we will consider the following general class of M - stage optimal control 
problems, where the time horizon of interest [to, £m] Is divided into M model 
stages corresponding to the subintervals [£*, t*+i], i = 0, 1, . . . , M — 1. 

In the following Xi are the differential states, Z{ are the algebraic states, Ui 
are the controls, p are the global parameters and U are time points of the 
time horizon, with i signifying the respective model stage. 

The performance index may be of Bolza type 



min 

> Zi , Ui , p , ti 




( Xi ( t ) , Zi ( t ) ,Ui(t),p,t)dt 






(la) 



subject to the DAE model stages 
Bi(-) Xi(t)=fi(xi(t), Zi(t),Ui(t),p,t) 

0 =9i ( Xi(t),Zi(t),Ui(t),p,t ) 



, te[ti,t i+ 1], * = o, l, . . . , M— l, 

(lb) 



the control and path constraints 

hi(xi(t),Zi(t),Ui(t),p,t) > 0, te[U,t i+ 1 ], i = 0,1,...,M-1. (lc) 
the stage transition conditions 

Xi+i(t i+ i) = Ci(xi(ti +1 ),Zi(ti +1 ),p,t i+1 ), * = 0, 1, . . . , M— 2. (Id) 

and the multipoint boundary conditions 
M - 1 

(ri(xi(ti),Zi(ti),p,ti) + rf(x i (ti +1 ),z i (t i+1 ),p,t i+1 )) 

i=0 




{>}°- ^ 



3 Two Direct Multiple Shooting Methods for DAEs 

The original continuous problem is reformulated as a NLP problem with a fi- 
nite number of optimization variables. On each model stage i = 0, 1, ... , M— 1, 
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we employ the time transformation #*(r, v) := U + rdi, U = to 4- Y^k = n dk,r e 
[0, 1] with v := (to, do, di, . . . , cZm-i), and we choose a fixed, dimensionless dis- 
cretization grid 



0 = T it o < Ti,i < ... < Ti, m .= 1. (2) 

Then we define a piecewise approximation üi of the control vector Ui by 

üi{r) := (Pijfaqij), r e hj = [n^Ti^ 1], j = 0, 1, . . . , mi-1, (3) 

using “local” control parameters q^. The functions cpij are given basis func- 
tions, typically vectors of polynomials (e.g., constant, linear, or cubic). 

The DAEs (lb) are discretized on the same grid (2) by a specific variant 
of multiple shooting which has been proposed by Bock et al. (1988 [6]). We 
introduce additional optimization parameters sfj, s\^ and solve the following 
set of relaxed decoupled initial value problems (IVPs) 

Bi( • ) dxi{T)/dT=fi{xi{r), Zi(r), ip%j(T, qa),p, 0i(r, v j) d t ) 

0 =gi(xi(r), Zi(r), ipij (t , qij),p, 0»{r, v)) > , t € Iij, 

- Otij(r) gi(sfj,sfj, (fij (Tij , qij ), P, Oiin^v)) ) 

(4) 

using Xi{rij) = sfj and Zifcj) = s\j as initial values. The scalar damping 
factor ctij is given by a scalar function which is non-increasing and non- 
negative on Iij and satisfies o^- (r^- ) = 1. Let Xi(rij+ 1 ; s?-, sf •, , p, v) denote 

the differential state values at r — Tij+i obtained by numerical integration 
of (4). The integral terms of the performance index are reformulated as a 
Mayer objective with the introduction of an additional differential state. The 
control and path constraints are discretized on the multiple shooting grid (2). 
Now the complete reformulation of the continuous M-stage optimal control 
problem leads to the NLP problem 



M— 1 

min V s\ , p, 

p.« “ 



(5a) 



subject to the continuity and consistency conditions 



Xi(n,j+i; sfj, sfj, q^ , p, v) - sf J+1 =0, j = 0,1,.. 

9i(Sij,Sij,<Pij(Tij,qij),P, 0i{Tij,v))= 0, j = 0,1,.. 
the discretized control and path constraints 



, TOj — 1 1 * = 0,1, 

,rrii Af-1, 

(5b) 






(j = 0, l,...,TOi, 

\* = 0,1,...,M-1, 



the stage transition conditions 



(5c) 






mi » i,mi 



,P,0i(Ti, mi ,v)) ~ Sf +1)0 



0, i = 0,1,..., M-2, (5d) 
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and the linearly coupled multipoint constraints 
M— 1 

( r i(<o><o>PA( r M),v)) + rf(sf >m .,sZ m .,p,0i(T itmi ,v))) 

i = 0 

The global model parameters (p, v) are “localized” by introducing new NLP 
variables (p, v)ij together with additional linear constraints enforcing (p, v)ij — 
(p, v) 0 ,o — 0 for all 7 ^ (0,0). Then only linear coupling occurs between 
variables corresponding to different discretization intervals. 

This structured NLP problem (5) is solved by specially tailored SQP 
(Bock, Plitt 1984 [4], Leineweber 1999 [11]) and Gauss-Newton methods 
(Bock 1981 [2], 1983 [3], 1987 [5], Schiöder 1988 [13]) in case of general or 
Least-Squares functions in the objective respectively. In order to motivate the 
later presented algorithms a general concept of a reduced SQP (see Gabay 
1982 [9], Schulz 1996 [14], Leineweber 1999 [11]) method is introduced for 
the following NLP problem 




{>} 0. (5e) 



f G 1 (w) = 0 

min F(w) s. t. < G 2 {w) — 0 . (6) 

w { H(w) > 0 

This problem is iteratively solved by computing the SQP iterates 

w k +i =w k + a k Aw k (7) 



where a k is used for globalization by e.g. line search. The calculation of the 
step Awk is divided into two parts through introduction of a coordinate basis 



CM) 



Aw k = 



V7 - 1 V7 

'V Wl O- 1 j fe V w 2 



CiT 

U l,k 



Vk + 



Vk> 



(8) 






:=S« 



where we use a partitioning of the NLP variables w = (w\,W 2 ) such that 
is nonsingular. Note that the linearized constraints of G\ are used 
to set up this coordinate basis. 

The range-space component y\ f is defined by 



Vk ■■= -V Wl Gl^G ltk 



( 9 ) 



and the null-space component is the solution of the following reduced QP: 




crossterm red. Hessian 



(10) 



s. t. 



G 2 , fe + VGl k Sfy« + VGl k S*yK = 0 
H k + Sfyj} + VH? > 0 ' 
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Here Lk is the Lagrange function for the NLP problem (6). Two remarks 
are in order: first, a good approximation of the crossterm is easily available 
if the objective function is of Least-Squares type. In this case Gauss-Newton 
Hessians are used which give a direct mathematical equivalence of a reduced 
space algorithm and a full-space algorithm. Second the reduced Hessian for 
general objective function will be usually approximated by BFGS-Updates 
for which the difference of the reduced Lagrange gradients Sj^'[\7Lk + 1 — 
Sj? T VLfc and the null-space step y % are needed to define the update between 
w k and Wfc+i. 

In the following two different levels of reduced space algorithms are pre- 
sented. The first one is characterized by defining as the consistency 
conditions, G2,k as the continuity, stage transition and multipoint equality 
conditions and Hk as the discretized control and path constraints and multi- 
point inequality conditions. This has several consequences: as in the full-space 
variant the Hessian of the reduced KKT system is block diagonal. Also the in- 
tegrations on different multiple shooting intervals are completely decoupled 
and can therefore be performed in parallel. This algorithm was developed 
by Leineweber 1999 [11], and implemented in the code MUSCOD-II. This re- 
duced space variant has high computation times for process models described 
by PDEs and discretized by the Method of Lines because of dense continuity 
Jacobians and Hessian blocks. Here the dimension of the differential states 
becomes dominant. 

The second algorithm is characterized by additionally using the continu- 
ity and initial conditions on the differential states in Gi^ instead of 
The continuity conditions in G\^ leads to the fact that the Hessian is not 
block diagonal and that the reduced Jacobians VG^S^ and VH^Sj? have 
entries corresponding to variables on nodes before the constraints are defined. 
In case of e.g. fixed initial values for the differential state the dimension of 
the reduced QP (10) is independent from the model dimension. This algo- 
rithm was developed by Schäfer et al. 2003 [12] and implemented in the code 
MSOPT. In the context of Parameter Estimation this method was developed 
and implemented by Schiöder 1988 [13]. 

Both algorithms intertwine the projection and gradient evaluation steps 
in the reduction process so that it can be shown that it suffices to compute 
a reduced number of directional derivatives for one (reduced) SQP step: 

n(n x d + n xa + n u + n p ) -> n(n x d + n u +n p + 1) 

V ' ' V ' 

MUSCOD-II, full-space MUSCOD-II, reduced space 

— > ^ n(n T 1 )n u 4 -nn p + n 

" V ' 

MSOPT 

using the following abbreviations for the dimensions: n number of multiple 
shooting intervals, n x d number of differential variables, n xa number of alge- 
braic variables, n u number of controls, n p number of global parameters. 
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In order to calculate the directional differential state derivatives the BDF 
integrator DAESOL is used, see Bauer 2000 [1]. The derivatives are calculated 
as the solution of the directional Variational Differential Algebraic Equations 
(VDAE). In case of MUSCOD-II the linearized discretized BDF equations of 
the directional VDAE are directly solved around the solution of the nominal 
trajectory. Here the iteration matrix has to be computed in every BDF step. 
For a high number of directions this approach is advantageous and shows good 
performance in practice. In case of MSOPT the discretized BDF equations 
of the directional VDAE are solved iteratively together with discretized BDF 
equations of the nominal trajectory. Here the same iteration matrix is used. 
This approach conforms to the principle of Internal Numerical Differentiation 
(IND), see Bock 1981 [2]. The main idea is to differentiate the integrator 
scheme for calculation of the nominal trajectory. As a result the directional 
derivatives are computed efficiently and with high accuracy! 

For the BDF integrator the model Jacobians are evaluated. It is neces- 
sary to do this very fast with the required accuracy. This is done with the 
algorithmic differentiation tool Adol-C (see Griewank et al. 1996 [10]). Since 
most model Jacobians are in general sparse a seedmatrix compression is used 
similar to the one proposed by Curtis et al. 1974 [7] to speed up computation 
time. The sparsity structure of the model Jacobians has to be computed only 
once for each model stage and is then stored. 



4 A Distillation Column as a Benchmark Problem 

As an application we consider the control of a high purity binary distillation 
column. The column is used to separate a binary mixture of Methanol and 
n-Propanol and has 40 bubble cup trays. An electric heating is used in the 
reboiler, the overhead vapor is totaly condensed in a water cooled condensor. 
The preheated feed stream enters the column at the feed tray as saturated 
liquid, feedstream can be generated in arbitrary mixtures. Control variables u 
are the heat input in the reboiler and the reflux flow rate. The model consists 
of 84 differential states x (concentrations, molar holdups) and 122 algebraic 
states z (liquid and vapor fluxes, temperatures) and is described in Diehl 
(2001 [8]) on two model stages which conform to (lb). In order to generate 
high purity specifications we punish the deviation of the temperatures at 
trays 14 and 28 from reference temperatures (and add a regularization term) 



rto 

min / 

Jto 



*0+T p 



fz(t)-T r J\ + ||Ä(u(*)-u s )||H dt (11a) 



subject to the hydrodynamic model equations leading to an index one DAE 
system of the form 



x(t) = f(x(t),z(t),u(t),p ) 
0 = g(x(t),z(t),u(t),p), 



t € [to> to + Tp], 



(lib) 
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control conditions 



u(t ) — u Sl t G [to -f r c , to + Tp], (ll c ) 

initial conditions 

x(to) = X 0 , (lid) 

and path constraints 

/ molar outflow out of the reboiler \ . u * , ^1 

y molar outflow out of the condenser ) ~ ’ ^ 1 o? o p \ • ( e ' 

Fixed intial states are given so that the system is not in steady state. A 
Gauss-Newton variant is used for this type of problem. This optimal control 
problem is solved by MUSCOD-II and MSOPT in 7 iterations. In table 1 the 
computing times for one RSQP iteration of both algorithms on a 2.8 Ghz 
Intel Xeon processor under Linux 2.4.19 and GCC 3.2 are presented. 



time [sec] 


MUSCOD-II 


MSOPT 


integration 


0.95 


0.94 


derivative generation 


23.76 


6.42 


constraint reduction 


0.32 


0.13 


solution of reduced QP 


0.03 


< 0.01 



Table 1 . Computing times for one RSQP iteration 



Most of the time for calculation of one RSQP step is needed for the deriva- 
tive generation. It is drastically reduced (here factor 4) since in the case of 
MSOPT we have to calculate 63 directional derivatives in contrast to 609 
directional derivatives of MUSCOD-II (both with 7 multiple shooting inter- 
vals). The computation times for MUSCOD-II can be sped up by parallel 
calculation of the directional derivatives. 



5 Conclusions and Outlook 

We have presented two numerical methods for the optimization of constrained 
large scale nonlinear processes. We have shown practical applicability to a 
real world distillation column, an example with few controls, few multiple 
shooting intervals and fixed initial values. 

The new algorithm implemented in the code MSOPT shows to be advanta- 
geous for these large scale optimization problems with not too many multiple 
shooting nodes, fixed initial values and a moderate number of controls. 
Extensions of MSOPT for the online case are planned. Especially adaptation 
of the initial value embedding technique are promising (see Diehl 2001 [8]). 
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Abstract. The satisfiability (SAT) problem is a central problem in mathematical 
logic, computing theory, and artificial intelligence. An instance of SAT is specified 
by a set of boolean variables and a propositional formula in conjunctive normal 
form. Given such an instance, the SAT problem asks whether there is a truth as- 
signment to the variables such that the formula is satisfied. It is well known that 
SAT is in general NP-complete, although several important special cases can be 
solved in polynomial time. Semidefinite programming (SDP) refers to the class of 
optimization problems where a linear function of a matrix variable X is maximized 
(or minimized) subject to linear constraints on the elements of X and the additional 
constraint that X be positive semidefinite. We focus on the application of SDP to 
obtain proofs of unsatisfiability. Using a new SDP relaxation for SAT, we obtain 
proofs of unsatisfiability for some hard instances with up to 260 variables and over 
400 clauses. In particular, we can prove the unsatisfiability of the smallest unsat- 
isfiable instance that remained unsolved during the SAT Competition 2003. This 
shows that the SDP relaxation is competitive with the top solvers in the competi- 
tion, and that this technique has the potential to complement existing techniques 
for SAT. 



1 Introduction 

The satisfiability (SAT) problem is a central problem in mathematical logic, 
computing theory, and artificial intelligence. An instance of SAT is specified 
by a set of boolean variables and a propositional formula in conjunctive nor- 
mal form. Given such an instance, the SAT problem asks whether there is 
a truth assignment to the variables such that the formula is satisfied. It is 
well known that SAT is in general NP-complete, although several important 
special cases can be solved in polynomial time. There has been great interest 
in the design of efficient algorithms to solve the SAT problem; see [9] for an 
extensive survey. 

Semidefinite programming (SDP) refers to the class of optimization prob- 
lems where a linear function of a matrix variable X is maximized (or min- 
imized) subject to linear constraints on the elements of X and the addi- 
tional constraint that X be positive semidefinite. A variety of polynomial- 
time interior-point algorithms for solving SDPs have been proposed in the 
literature, and several excellent solvers for SDP are now available. We refer 
the reader to the recent handbook [18] for a thorough coverage of the theory 
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and algorithms in this area, as well as several application areas where SDP 
researchers have made significant contributions. We note that SDP has been 
very successfully applied in the development of approximation algorithms for 
hard combinatorial optimization problems. The survey paper [12] provides 
an excellent overview of the results in this area. 

We are interested in the application of SDP to the basic SAT problem, 
and in particular in how SDP can be used to prove unsatisfiability. In [7,8] de 
Klerk et al. introduced an SDP relaxation for SAT, the Gap relaxation (de- 
fined below), which characterizes unsatisfiability for some interesting classes 
of SAT problems, such as mutilated chessboard and pigeonhole instances, 
as well as for 2- SAT. However, the Gap relaxation cannot detect unsatisfi- 
ability when all the clauses have length three or higher. More recently, we 
introduced in [2] an improved SDP relaxation which can be used to prove 
that a given SAT formula is unsatisfiable, independently of the lengths of the 
clauses in the instance. This relaxation is easily defined for every instance of 
SAT, and it inherits all the favourable properties of the Gap relaxation. It 
is constructed using ideas from a “higher liftings” paradigm for constructing 
SDP relaxations of discrete optimization problems. 

The use of liftings has been proposed in the literature within the frame- 
work of general purpose lift-and-project methods for 0-1 optimization (see for 
example [5,15,13]). To summarize the paradigm behind the higher semidef- 
inite liftings, suppose that we have a discrete optimization problem on n 
binary variables. The SDP relaxation (or Shor relaxation) in the space of 
(n -f 1) x (n + 1) symmetric matrices is called a first lifting. Note that the 
rows and columns of the matrix variable in this relaxation are indexed by the 
binary variables themselves. To obtain higher semidefinite liftings, we allow 
the SDP relaxations to have the rows and columns of the matrix variable 
indexed by subsets of the discrete variables in the formulation. These larger 
matrices can be interpreted as higher liftings, in the spirit of the second lift- 
ing proposed in [4] and its generalization independently proposed in [11,10]. 
A further generalization of this paradigm, which lifts an n-tuple of binary 
variables into the subset algebra of that space, has recently been investigated 
in [6]. Alternatively, if a 0-1 problem is viewed as a feasibility problem over 
an algebraic set, then SDP relaxations can be obtained using Hilbert’s posi- 
tivstellensatz [14]. 

From a computational point of view however, all these lifting techniques 
suffer from the fact that the size of the SDP relaxations grows very rapidly 
with the number of binary variables. For example, only second liftings for 
Maximum-Cut problems with only up to 27 binary variables were successfully 
solved in [1]. By contrast, using the SDP relaxation from [2] which can be 
viewed as a “partial” lifting more amenable to practical computation than the 
complete higher liftings, we obtained proofs of unsatisfiability for some hard 
instances with up to 260 variables and over 400 clauses. In particular, we were 
able to confirm the unsatisfiability of the smallest unsatisfiable instance that 
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remained unsolved during the SAT Competition 2003. This shows that the 
SDP relaxation is competitive with the top solvers in the competition, and 
that this technique has the potential to complement existing techniques for 
SAT. These results further motivate our ongoing research towards a practical 
SDP-based algorithm for satisfiability. 



2 The SDP Relaxation for SAT 



We consider the SAT problem in conjunctive normal form (CNF). An instance 
of SAT is specified by a set of variables x\,...,x n and a propositional formula 

m 

$ = /\ Cj, with each clause Cj having the form Cj = V x k V V x k 
J=1 kE. Jj k€Jj 

where Jj,Jj C {1, . . . ,n}, Jj D Jj = 0, and Xi denotes the negation of X{. 
(We assume without loss of generality that | Jj UJj\ >2 for every clause Cj.) 
The SAT problem is: Given a satisfiability instance, is satisfiable, i.e. is 
there a truth assignment to the variables x \, . . . , x n such that $ evaluates to 
TRUE? Special instances of SAT with certain constraints on the length of 
the clauses are often of particular interest, both theoretically and in practice. 
The notation fc-SAT refers to those instances of SAT for which each clause 
Cj satisfies | Jj U Jj\ < k. 

de Klerk et al. [7,8] introduced the Gap relaxation for SAT which is de- 
signed for detecting unsatisfiability. Indeed, they show that it characterizes 
unsatisfiability for some interesting classes of SAT problems, such as muti- 
lated chessboard and pigeonhole instances, as well as for 2- SAT problems. 
For clause j and k e Jj U Jj , define 



f 1, if k e Jj 
y —1, if k G Jj 



(i) 



Let 1 denote TRUE and —1 denote FALSE, and let l(Cj) = \JjU Jj | denote 
the number of literals in clause Cj. The Gap relaxation for 3-SAT may be 
expressed as follows: 

find X £ <S n+1 

s.t. 

Sj,il A" %1^%2 Ao,ii Ao,Z2 "F ^ 

where {i\, 22 } = Jj U Jj , if l(Cj) = 2 
Sj,ii ^j,i 2 ~F Sj,ii Sj,i3 A ii,is “1“ A^ 2 ,i 3 ^j,i 1 Ao,ii $j,i 2 A(),i 2 

—Sj t i 3 X 0 ,i 3 < 0, where {zi, 22 , ^ 3 } = Jj U Jj, if l{Cj) = 3 
diag (X) = e 
XhO 



where S n denotes the space of nxn symmetric matrices, diag (X) represents a 
vector containing the diagonal elements of X, e denotes the vector of all ones, 
and X >z 0 denotes that X is positive semidefinite. This relaxation is based 
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on the application of the elliptic approximations introduced in [17], and the 
linear constraints in the SDP are obtained by expanding and linearizing the 
elliptic approximation for each clause. Using these elliptic approximations, 
it is straightforward to extend the Gap relaxation to SAT instances with 
any number of literals in each clause; however, the resulting relaxations are 
always feasible in the absence of clauses of length two, and hence unhelpful for 
detecting unsatisfiability. Rounding schemes and approximation guarantees 
for the Gap relaxation, as well as its behaviour on so-called (2 + p)-SAT 
problems, are studied in [7]. 

More recently, we proposed an improved SDP relaxation which is able to 
detect unsatisfiability independently of the length of the clauses, and inherits 
all the properties of the Gap relaxation. We outline here the construction and 
properties of that relaxation; the complete details are presented in [2]. With 
Sj^k as defined in (1), we have from [2, Proposition 1] that for l(Cj) > 2, 
clause Cj is satisfied by X{ — ±1, i G JjU Jj, if and only if 



l(Cj ) 

Ei - 1 ) 1-1 



t= 1 




= 1. 



Using this condition, we formulate the problem in symmetric matrix space. 

Let P denote the set of nonempty sets I C {1, . . . , n} such that the term Yl 

i€l 

appears in the above formulation. Also introduce new variables xj := x u 

iei 

for each I € P; define the vector v . . . ,x/ p ) T , where p denotes 

the cardinality of P; and define the rank-one matrix Y := vv T , whose rows 
and columns are indexed by {0} U P. By construction of Y, we have that 
F 0j/ = xi for all I £ P. Using these new variables, we can formulate the SAT 
problem as: 



find Y eS 1+p 
s.t. 



l(Cj ) 

E(-i) 



t - 1 



t= 1 



E 

TCJjUJj,\T\=t 



n s j,i 

.<€ T 




3 






diag (Y) = e 
rank(F) = 1 
Yh 0 . 

Relaxing this formulation by omitting the rank constraint would give an SDP 
relaxation for SAT. However, in order to improve the SDP relaxation, we first 
add redundant constraints to this formulation. This approach of adding re- 
dundant constraints so as to tighten the resulting SDP relaxation is discussed 
in detail in [3]. 

The constraint rank(F) = 1 implies that for every triple ii,/ 2,/3 of 
subsets of indices in P such that the symmetric difference of any two equals 
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the third, the following three equations hold: 

*0,/i = Yi 2 i i 3 , Yqj 2 =1/i,/ 3 , and Y$j 3 =Y Iul2 . (2) 

Hence we can add some or all of these redundant constraints to the formu- 
lation (without affecting its validity). We add to the formulation above the 
equations of the form (2) for all the triples {Ii,l2,h} C P satisfying the 
symmetric difference condition and such that (7i U I2 U 13) C ( Jj U Jj) for 
some clause j. Our final formulation of the SAT problem is thus: 

find Y e S 1+p 
s.t. 

l(Cj ) 

E (- 1)*- 1 

t = 1 



E 

TQJjUJj,\T\=t 



n- 

i€T 






Y*a 



= 1, j = 



Yi 2 ,isi Y$i 2 Yj 1 j 3 , and Y$^j 3 Yj 1 ^j 2 , y ^ F 

such that I1AI2 = I3 and (ii U/2U/3) C (Jj U Jj) for some j 
diag (Y) = e 
rank(y) = 1 
Y hO 



where IiAIj denotes the symmetric difference of Ii and Ij. Removing the 
rank constraint yields an SDP relaxation with the following properties: 

Theorem 1 [2, Theorem 2] Given a SAT propositional formula in CNF, the 
following statements hold for the semidefinite relaxation above : 

• If the SDP is infeasible, then the formula is unsatisfiable. 

• If the SDP is feasible, and Y is a feasible matrix such that rankF < 3, 
then a truth assignment satisfying the formula can be obtained from Y. 
Hence the formula is satisfiable. 

Hence, to prove that a SAT instance is unsatisfiable, it suffices to verify 
that the SDP relaxation is infeasible (when that is indeed the case). We 
now present computational results that illustrate the potential of our SDP 
relaxation for proving unsatisfiability. 



3 Some Proofs of Unsatisfiability Via SDP 

Researchers in SDP have developed a variety of excellent solvers, most of 
which are freely available. An extensive listing of solvers is available at 
http : //www-user . tu-chemnitz . de/~helmberg/sdp_sof tware . html. For the 
application to SAT, it is important to use a solver which, when given an 
infeasible SDP, provides us with a certificate of infeasibility, because that 
certificate is for us a proof of unsatisfiability for the SAT instance. We used 
the solver SDPT3 (version 3.0) [16] with its default settings (available at 
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Table 1. Results for the Nine hgen8 Instances from SAT Competition 2003 



Problem 


# of 
variables 


# of 
clauses 


Size of 
Y 


# of SDP 
constraints 


SDP is 
infeasible 


Total CPU 
seconds 


Solved at 
SAT 2003 


nl20-01 


120 


197 


542 


3862 


Yes 


704 


Yes 


n 120-02 


120 


193 


537 


3838 


Yes 


611 


Yes 


nl20-03 


120 


193 


539 


3846 


Yes 


583 


Yes 


nl80-01 


180 


279 


793 


5668 


Yes 


2194 


Yes 


nl80-02 


180 


279 


793 


5668 


Yes 


2142 


Yes 


nl80-03 


180 


280 


791 


5661 


Yes 


2188 


Yes 


n260-01 


260 


391 


1132 


8096 


Yes 


6938 


No 


n260-02 


260 


404 


1143 


8153 


Yes 


7455 


No 


n260-03 


260 


399 


1134 


8112 


Yes 


7678 


No 



nl20-01 denotes problem hgen8-nl20-01-S563767109. shuff led-as .sat03-875 
nl20-02 denotes problem hgen8-nl20-02-S 1654058060. shuff led-as. sat03-876 
nl20-03 denotes problem hgen8-nl20-03-S1962183220. shuff led-as. sat03-877 
nl80-01 denotes problem hgen8-nl80-01-S1524349002. shuff led-as . sat03-880 
nl80-02 denotes problem hgen8-nl80-02-Sl 125510326. shuff led-as. sat03-881 
nl80-03 denotes problem hgen8-nl80-03-S1436192352. shuff led-as. sat03-882 
n260-01 denotes problem hgen8-n260-01-S 159773245 1 . shuff led-as . sat03-885 
n260-02 denotes problem hgen8-n260-02-S1396509323. shuff led-as. sat03-886 
n260-03 denotes problem hgen8-n260-03-S722413478. shuff led-as. sat03-887 



Table 2. Results for the Additional hgen8 Instances 



Problem 


# of 
variables 


# of 
clauses 


Size of 
Y 


# of SDP 
constraints 


SDP is 
infeasible 


Total CPU 
seconds 


200-01 


200 


309 


881 


6290 


Yes 


2821 


200-02 


200 


314 


882 


6299 


Yes 


3243 


200-03 


200 


306 


877 


6271 


Yes 


2530 


220-01 


220 


339 


966 


6900 


Yes 


3843 


220-02 


220 


344 


969 


6917 


Yes 


4279 


220-03 


220 


341 


967 


6906 


Yes 


4757 


240-01 


240 


362 


1044 


7475 


Yes 


5455 


240-02 


240 


365 


1047 


7490 


Yes 


5563 


240-03 


240 


366 


1046 


7487 


Yes 


5376 
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http ://www. math. nus.edu. sg/ "'matt ohkc/sdpt3. html) and running on a 
2.4GHz Pentium IV with 1.5Gb of RAM. 

The results we present are for randomly generated SAT instances ob- 
tained using the generator hgen8. The source code to generate these in- 
stances, which includes an explanation of their structure, is available at 
http : / /logic . pdmi . ras . ru/~hirsch/benchmarks/hgen8 . html. A set of 12 
instances generated using hgen8 was submitted for the SAT competition 2003 
(see http : //www . satlive . org/SATCompetition/2003/index . j sp). We ver- 
ified that our SDP relaxation is infeasible for nine of these instances; these 
results are presented in Table 1. (The SDP relaxations for the remaining in- 
stances in the set were too large for the computing resources available.) In 
particular, the SDP relaxation was able to prove the unsatisfiability of the in- 
stance n260-01 in Table 1, which was the smallest unsatisfiable instance that 
remained unsolved during the competition. (An instance remained unsolved 
if none of the top five solvers was able to solve it in two hours, running on an 
Athlon 1800+ with 1Gb of RAM.) Indeed, the SDP relaxation appears to be 
quite effective on the type of instances generated by hgen8, as we randomly 
generated several more instances of varying sizes and all the corresponding 
SDP relaxations were infeasible. The additional results are presented in Ta- 
ble 2. It would be interesting to relate the structure of these instances to the 
success of the SDP relaxation. 

To conclude, our main point here is that for some instances of SAT, the 
SDP relaxation is competitive with the top solvers in the SAT 2003 com- 
petition, and therefore the SDP approach has the potential to complement 
existing techniques for SAT. These results are an encouraging step in our 
ongoing research towards a practical SDP-based algorithm for satisfiability. 
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Abstract. This paper aims at describing a metric problem of finding two minimum 
total weight edge-disjoint Hamiltonian circuits in a graph with two weight functions. 
The problem is NP - hard in strong sense if the weight functions w\ and W 2 are 
different or equal. We construct two approximation 0(n 3 ) algorithms whose worst- 
case performance guarantees asymptotically equal 12/5 (in case of the different 
functions), and 9/4 (when wi and W 2 are equal). 



1 Introduction 

Let G = (V, E) be a complete undirected graph with n vertices. The edges 
of the graph are weighted with two functions W\ : E —> R, W2 : E —> R. It is 
supposed that the triangle inequality holds 

wi (i,j) < wxfak) + wi(j,k),w 2 (ij) < w 2 (hk) +w 2 (j,k) 

for each three vertices i, j, k G V. By Wi(H) we denote Wi(H) = J2 e eH w i( e )> 
where i = 1 , 2 . We consider a problem of finding two edge-disjoint Hamilto- 
nian circuits Hi C E and H2 C E such that their total weight Wi(Hi) + 
^2(^2) is minimal. The problem is iVP-hard in strong sense if the weight 
functions w\ and W2 are different or equal. 

2 Complexity of the Problem 

It can be easily seen that the problem is WP-hard in general case. For any 
minimum TSP with a weight function w of edges let w\ = w, W2 = 0 . For 
these weight functions w\ and W2 optimality of a solution of our problem gives 
optimality of one Hamiltonian circuit from the solution for the minimum TSP. 

But we are interested also in the case of equal weight functions W\ = W2 , 
thus let us proceed to the proof of its iVP-hardness. 

* This research was supported by the Russian Foundation for Basic Research (grant 
02-01-01153), Project of Russian Federation ’’Nauchnaia Shkola-313. 203.1”, and 
INTAS (grant 00-217) 
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We need to show that the problem of finding two edge-disjoint Hamilto- 
nian circuits in a graph is iVP-hard. For that we will reduce the Hamiltonian 
circuit problem to this one. 

A simple graph G = (V,E), V = {ui, . . . , u n } is given. It is required to 
find a Hamiltonian circuit H in it or to show that it does not exist. 

We will refer to the case of^even n. We construct a graph G that corre- 
sponds to the given graph G. G consists of two copies of G connected by n 
four- vertex cliques ATi, . . . , K n . 

An example of such a construction is shown on Fig. 1. 




On the graph G we solve a problem of finding two edge-disjoint Hamilto- 
nian circuits. 

Lemma 1. If there is a Hamiltonian circuit in G , then there are two edge- 
disjoint Hamiltonian circuits in G. 

Proof Suppose we have a Hamiltonian circuit H in G. The cycle can be de- 
composed mto two perfect matchings. For the first Hamiltonian Jdamiltonian 
circuit in G we take the first matchingjn the first copy of G in Ö, the second 
matching in the second copy of G in G and n connecting paths that connect 
corresponding copies of vertices from G in G. The second Hamiltonian cir- 
cuit is constructed symmetrically, although the connecting paths are chosen 
differently in order to make these two Hamiltonian circuits edge-disjoint. 

Lemma 2. If there are two edge- disjoint Hamiltonian circuits in G, then 
there is a Hamiltonian circuit in G. 

Proof Suppose we have two Hamiltonian circuits in G. Let one of this Hamil- 
tonian circuits be H. If we unite pairs of copies of vertices from G in G and 
get rid of the connecting constructions between them, then the Hamiltonian 
circuit H transforms into a Hamiltonian circuit in G. 

Lemmas 1 and 2 show that the problem of finding a Hamiltonian circuit 
in a graph with even number of vertices is polynomially reducible to the 
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problem of finding two edge-disjoint Hamiltonian circuits in a graph. The 
last problem is from NP class, and the first is NP- complete. We conclude 
that the last problem is NP- complete. 

3 Algorithm 1 for the Metric Problem with Equal 
Weight Functions 

Let w\ — W2 = w. We want to find two edge-disjoint Hamiltonian Hamilto- 
nian circuits Hi C E H2 C E, such that W(H\) + W(H2) is minimum. Let 
the minimum total weight of these Hamiltonian circuits be W * . 

Stage 1. We find the first Hamiltonian circuit Hi C G using Christofi- 
des’s and Serdyukov’s algorithm [1,2]. Assume Hi = {1, 2, . . . , n, 1}. 

Stage 2. If n is odd, then H2 = (1, 3, 5 , . . . , n, 2, 4 , . . . , n — 1, 1} and 
Algorithm 1 has finished. Else Algorithm 1 performs stage 3. 

Stage 3. (The stage 3 is performed if n is even.) Let C2 (pro tanto C3) be 
a totality of the n different edges like (z, z + 2) (pro tanto (z, z + 3)). Obviously, 
C2 C G is a 2-factor which consists of two cycles C' = {1,3, ...,n — 1,1} 
and C" = {2, 4 , . . . , n — 2, n, 2}. The former cycle includes all odd nodes, the 
latter cycle includes all even nodes. 

Description of Algorithm 1 is complete. 

Consider a system {if 1 , . . . ,if m } of m = n /2 Hamiltonian circuits (see 
Fig. 2). 




Fig. 2. 



The Hamiltonian circuit if J is obtained by splicing the cycles C f and 
C n . Recall that C2 = C'ljC" is 2-factor. We delete two edges (2(m — j) + 
1, 2(m — j) + 3) G C and (2(m — j)+4, 2 (m— j)+6) G C" from C2 and add 
two new edges (2(m — j) + 1, 2(m — j) +4), (2(m— j) + 3, 2 (m — j) + 6) G C3 
(see Fig. 3). 

We choose H2 as the minimum weight Hamiltonian circuit from the sys- 
tem {if 1 ,...,#™}. 

Theorem 1. If the weight functions are equal, then the metric problem of 
finding two edge- disjoint Hamiltonian circuits can be solved by Algorithm 1 
in time 0(n 3 ) with the following performance guarantee 

A _ f 9/4, if n is odd ; 

{ 9/4 + 3/n, if n is even. 
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Proof. CASE 1: n is odd . Let us denote by W PSP the minimal of the Hamil- 
tonian circuit’s weights. Obviously, that 2 Wtsp < W*. According to the 
algorithm from [1,2] 

W{H{) < (3/2 )W} SP . 



We have W(H 2 ) < 2W(H\) by the triangle inequality. Using the previous 
inequalities we have 

= WjHi) + W(H 2 ) 3 W{H X ) 3(3/2 )W? gP = 

W* ~ 2W tsp ~ 2W tsp ' 

CASE 2: n is even. Note that a total weight of all Hamiltonian circuits 
ff 1 , . . . , is equal to (m — l)W(C 2 ) + 2W(Cs). Hence the minimum weight 
of a Hamiltonian circuit from the set satisfies the inequality 



W(H 2 ) < 



(m-l)W(C 2 ) + 2W(C 3 ) 
m 



Since the triangle inequality we have 

W(C 2 ) < 2W(H 1 ) 1 W(C 3 ) < 3W(iJi). 



Hence 



W{H 2 ) < 2W(H 1 )(1 + 2/m). 



Taking into account the previous inequalities we have the performance 
guarantee in case n is even 



A = W(ffi) + W(H 2 ) < W{Hx) 4- 2W'(jffi)(l 4- 2 /m ) 



W* 



2Wr 



TSP 



iy(g,)(3 + 2/m) < (3/2)W? sf (3 + 2/m) = 9/4(l + 4/(3n)) 



2 IT. 



TSP 



2 Wr 



TSP 
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4 Algorithm 2 for the Metric Problem with Different 
Weight Functions 

Let G\ — (Vi, £7i) = G — (V,E) with the weight function w\, G<i — 
(V 2 , E 2 ) = G = (V, E) with the weight function W 2 - 

Stage 1. We find two Hamiltonian circuits H\ C G\ and H 2 C G 2 
using the Christofides’s and Serdyukov’s algorithm [1,2]. Their weights satisfy 
JVi(Ei) < (3/2)Wi(fff) and W 2 (H 2 ) < (3/2 )TV 2 (E 2 *), where ify* and E 2 * 
are Hamiltonian circuits of minimum weight in G\ and G 2 . Clearly, that 
W\(Hl ) + W 2 (E| ) < TV*. If Ei and E 2 are edge-disjoint, then Algorithm 2 
has finished. Else Algorithm 2 performs Stage 2. 

Stage 2. We take Ei as the first Hamiltonian circuit. The aim of the stage 
2 is to convert H 2 into the Hamiltonian circuit H 2 which is edge-disjoint with 
Hi. First of all we renumber the edges of G according to E 2 . 

Let n = 5 ra+r, 0 < r < 5. Let S k be a set of chains (intervals) P/, . . . , P™ 
which consecutively lie in H 2 and are obtained by dividing H 2 into m — r 
parts that consist of 5 linked edges, and into r parts that consist of 6 linked 
edges. The index k means that the first chain P k begins with the node k = 
1, 2, . . . , K where 

K _ f 5, if n is divisible by 5; 

[ n, if n isn’t divisible by 5. 

Let denote by e' ik and e'' fc the terminating edges of P k . 

We organize the sets S 1 , . . . , S K of the chains^ described above. The nodes 
of every chain P E S k are detoured on the path P which possess the following 
properties: 

1°. P starts with the first node of the chain; 

2°. P passes every inner node only once; 

3°. P finishes at the end node; 

4°. P does not intersect the edges of Hi. _ 

(Later, Lemma 3 shows the correctness of finding the path P that consists 
of 5 or 6 edges). 

We splice all paths found for the set S k , and obtain a Hamiltonian circuit 
H k which doesn’t intersect with the edges of Hi. We choose H 2 as a solution 
where H 2 is minimum weight Hamiltonian circuit from H 1 , . . . , H K . 
Description of Algorithm 2 is complete. 

Further, we assume w = W 2 - 

Lemma 3. Let the chain P E H ^ consist of 5 or 6 consecutively joined 
edges. We can construct the path P (which possesses the properties l°^k°) 
for a constant number of atomic operations. And P has total weight 

W(P ) < 3 • 1V(P) - 2 (w(e f ) + w{e")), 

where e r and e" are the first (starting) and the last (finishing) edges of the 
chain. 




321 



The proof is omitted. 

Lemma 4. The length of the Hamiltonian circuit H 2 satisfies the condition 

J (11/5) TT (Ä 2 ), if n is divisible by 5; 

' 2 ~ \ (11/5) (l + 16/(lln))W(H2) 1 if n is not divisible by 5. 

Proof Since Lemma 3 for the lengths of Hamiltonian circuits if 1 , . . . ,H K 
we have 



W(H k ) = £ W(P k ) < 3 Y, W (Pi) -2 £>(4) + «>(4)) 

i=l i— 1 i—1 

m 

< 3 W(H 2 ) - 2 + «>(4))- 

i=l 

For the length of the Hamiltonian circuit H 2 we get 



n— 1 

W(i/ 2 ) = w(n, 1) + ^2w(j,j + 1). 

j'=i 

As the Hamiltonian circuit H 2 has the least weight of Hamiltonian circuits 
if 1 , . . . , H K we conclude that 

_ K Km 

W(H 2 ) < (1 /K)^W(H k ) < 3 W(H 2 ) - (2 /iO££M4) +™(4))- 

k = 1 /c=l i=l 

If n is divisible by 5, we have 

5 5 m 

^(ff 2 ) < (l/5)£w(tf fc ) < 3 W(H 2 ) - (2/5 )££M4) +M4))- 

fc=l fc=l i=l 




Fig. 4. 



On the Fig. 4 gray and black colors represent (for each 5-edge’s chain) 
first and last edges respectively. We substruct this edges namely. 

Considering that each edge e of the Hamiltonian circuit H 2 is added in 
the sum exactly twice we get 

W(H 2 ) < 3 W(H 2 ) - (2/5)2 W(H 2 ) = (11/5 )W(H 2 ). 
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If n is not divisible by 5, we have 

n n m 

W(H 2 ) < (l/n) W(H k ) < 3 W(H 2 ) - (2/n) EE«4)+*(4))- 

fc=l fc=l i=l 

Since each edge e of the Hamiltonian circuit H 2 is added in the sum exactly 
2m times we get 

W(H 2 ) < 3W(H 2 ) - (2/n)2mW(H 2 ). 

Using an inequality 5m > n — 4 we conclude 

W{H 2 ) < (11/5) (l 4- 16/(11 n))W(H 2 ). 

The lemma is proven. 

Theorem 2. If the weight functions are different, then the metric problem 
of finding two edge-disjoint Hamiltonian circuits can be solved by Algorithm 
2 in time 0(n s ) with the following performance guarantee 

A < f (12/5), if n is divisible by 5; 

~ \ (12/5) (l + l/n), if n is not divisible by 5. 

Proof. First of all we find the performance guarantee. 

CASE 1: n is divisible by 5. From the inequalities 



Wi(fff) + W{H%) < W* < Wi(Hi) + W(H 2 ) 

W\(H\) + (11/5 )W(H 2 ) < (3/2 )(W 1 (H?) + (ll/5)fFi(U 2 *)) 



W 1 (H 1 ) + W(H 2 ) Z W^Hp + ^Wjm) = 3 / 6/5 n 

W* ~ 2 Wi(Hi) + W(H$) 2 V + 1 + f /’ 



where t = W^HD/W^). 

Exchanging the roles of G\ and G 2 we obtain the following inequality 

zs <5( 1 + _5iS r ). 

“ 2 V 1 + l/t) 

From here we have the performance guarantee of Algorithm 2 



j < |(i + mi }) s + 3/5) = 12/5 - 

CASE 2: n is not divisible by 5. Since Lemma 4 we have 



IF* + 
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=m(i + ™), 

where t = Wi(Hi)/W(H$). 

Exchanging the roles of G i and Go we obtain the following inequality 



<(3/2)( 



1 + 



6/5 + 16/(5n) 
1 + 1 /t 



)• 



Consequently 

4 < (3/2)(l + m.„{ 6 / 5 ^ 6 / 5 ") , 6/5 1 + + 1 ^ 5 " ) }) < 12/5(1 + 1/n). 



We can see the same performance guarantee for both cases when n is and 
is not divisible by 5. 

The time complexity of Algorithm 2 is determined by the time com- 
plexity of finding a maximum weight matching [3] in the Christofides’s and 
Serdyukov’s algorithm [1,2], which is 0(n 3 ). 
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Abstract. In many regions farmers cultivate a number of small lots that are dis- 
tributed over a wider area. This leads to high overhead costs and economically 
prohibits use of high tech machinery hence results in a non-favorable cost-structure 
of production. The classical form of land consolidation is typically too expensive and 
too rigid, whence consolidation based on lend-lease agreements has been suggested. 
In order to exploit the potential of this method specific mathematical optimization 
algorithms are needed, particularly since the underlying problem is NP-complete 
even in very restricted cases. 

This paper introduces a quadratic optimization model and shows its practicality 
for some typical regions in Northern Bavaria, Germany. 



1 Introduction 

In many regions in Germany and other countries individual farmers cultivate 
a number of rather small lots that are distributed over a wider area. Figure 
1 depicts an example from Northern Bavaria, Germany. 1 On the average, 
today’s Bavarian farmers cultivate twelve lots with an average size of 1.45 
hectare 2 (ha). 

Naturally, in such a situation the farmers are faced with an unnecessar- 
ily large unproductive overhead, the man power and equipment needed for 
reaching each individual lot. In fact, according to calculations of the State 
Institute of Bavaria for Agriculture (LfL) in Munich, Germany, this overhead 
may reach as much as about ten percent of the total net income. Further, 
larger machinery cannot be used profitably. The reason for such small-split 
farmland lies in the heritage laws combined with an increase of leased but 
not owned agricultural property. 

In the classical form of land consolidation all lots are first combined to 
one large region which is subsequently partitioned into the new individual 
properties of the corresponding farmers. At the same time the complete in- 
frastructure of the area is replanned. This legal change of ownership is very 

1 The reproduction process did not allow for colors; the original multicolor figures 
can be viewed under http://www-m9.ma.tum.de/dm/consolidation/OR2003 

2 1 ha = 10.000m 2 = 2, 471 acres 
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Fig. 1 . Status quo distribution of the lots of individual farmers; lots depicted in 
the same grey value belong to the same farmer. 



costly, time intense, rigid and its fairness is always up to dispute. In fact, 
the cost per hectare are about 2000 Euro, the duration of the procedure not 
rarely close to a decade, and normally each farmer is forced to participate. 

Therefore the LfL suggested a lend-lease based redistribution of the ex- 
isting lots. This means that the redistribution will not result in any resizing 
or legal change of ownership but only in a (temporary) reassignment of uti- 
lization. Consequently, the method is easy to implement, inexpensive and 
very flexible. It actually works on a voluntary basis, no farmer is forced to 
participate. Also individual preferences can be accommodated, and updates 
can be performed on any time scale that is required. 

In practice, the real bottleneck of this approach is that adequate tech- 
niques for the redistribution of utilization rights that take into account the 
quality of the soil, the (real or potential) European Union subsidy benefits 
and many other relevant factors are not at hand of the farmers or the experts 
of the ministry. In fact, even extremely simple seeming cases can be shown 
to be NP-complete, see [4]. 

The purpose of this note is to outline a new quadratic optimization model 
for the lend-lease based consolidation of farming. A more detailed description 
and analyses will be given in [4] . In Section 2 we present the core model and 
Section 3 contains computational results for two regions in Northern Bavaria. 

2 Mathematical Model 

Let the given farmland be split into - say - /* lots Zq, . . . , L/*, and let the 
function uj : {Zq,...,L/*} — » [0, oo[ associate with each lot its size (or soil 
quality or subsidy potential or any other kind of measure for its quality). 
Now, the lots are cultivated by - say - /* different farmers Fi, . . . , Ff * , i.e., 
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we are given a partition (7i, ...,//*) of the index set 7 = {1, . . . , such that 
for / = 1, . . . , /* the set Pf = {Li : l G //} describes the current property of 
farmer /; of course, ßf — J2iei f u (^i) 1S th e corresponding total farm size. 
We introduce variables £// that indicate whether lot l belongs to farmer /, 
i.e., for the given land distribution 




if Li G 7/, 
if L t £ If. 



Hence we can capture the conservation of size by means of the following 
system of linear equalities. 

Elli u(Li)£i f =ßf, / = i,...,/* 

Of course, in practice one would prefer more flexibility and allow for some 
small deviation; it can be modeled with the aid of some positive relative error 
parameters e/, / = 1 ,...,/*. Since each lot has to be assigned to precisely 
one farmer, we obtain the following system of constraints. 



Constraints 

T!i=MLi)ii f < (i + ef)ßf > 

ELi u(Li)€if > (1 - e f )ßf , 

E/=i 6/ = 1 

e {°>!} 



/ = !,•••,/* 
1 = 1 ,. .., 1 * 



Of course, it is straight forward to extend this model to capture other 
measures of quality of the lots and to accommodate individual preferences. 
For instance, if some farmers insist on some of their lots being excluded from 
the redistribution, we simply preset the corresponding variables to 1. 

Among all feasible solutions specified by the Constraints we are longing 
for one whose corresponding distribution is “optimal”; hence an objective 
function has to be fixed. Our model aims at minimizing the average distances 
between the lots of one farmer and maximizing the distances between lots of 
different farmers. More specifically, we identify with each individual farmer / 
the “virtual center of gravity” cgf of all his lots and maximize the sum of the 
square of their mutual Euclidean distances. (A mathematical justification for 
this approach in terms of separation is given in [4].) 

To compute cgf , we utilize information available through the geographic 
information system (GIS) of the LfL. In fact, besides information on lot sizes, 
soil quality, etc. GIS provides for each lot L\ a tuple gi = {gi^,gi^) T of co- 
ordinates, the arithmetic mean of Gauß-Krüger-coordinates of the “corners” 
of the lots. 3 Then the virtual center of gravity for farmer / is defined by 

1 r 

cg f = 

Pfti 

3 The Gauß-Krüger-coordinates are projections of points of the terrestrial sphere 
on a suitable tangent plane. 
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Note that we do not normalize by the actual farm size 



i* 

1=1 

but by the initial farm size /?/ in order to keep the constraints linear. We are 
then interested in the vectors of pairwise difference 

$fuh = (%,/ 2 ;i»%,/ 2 ; 2 ) T = cg fl - cg h , 1 < /i < < f* 

that altogether can be interpreted as a /*(/* — 1) dimensional vector x whose 
Euclidean norm ||x ||2 has to be maximized over the 0-1- vectors of a polytope. 
More precisely, we obtain the following optimization problem. 

Optimization Problem 



s.t. 



r- 1 r 2 

max Y Y 5 . 

/i = l /2=/i + l i= 1 



2 



J2 l i=iu(Li)£if 

Y!i = i v(Li)£i f 
S/= i 



< (1 + €f)ßf 
> (1 - €f)ßf 
= 1 

€ { 0 , 1 } 



ßf c 9f ~ T / i=i UJ ( L l)9l^lf = 0 
s fuh - ( c 9h ~ C9f 2 ) =0 



/ = !)•••>/* 

1 = 1 ,. .., 1 * 

/ = I» • • • ) /*; l = l, ■ ■ ■ ,l* 
/ = !»•••)/* 
l < fi < h < /*• 



Relaxing the constraints 

6/ € {0, 1} 

to 

o<6/ 

(note that the inequalities ^// < 1 are redundant) we obtain the problem of 
maximizing the (square of the) Euclidean norm over the orthogonal projection 
of a polytope in ((/* -f /* + l)/*)-dimensional space onto an (/*(/* — 1))- 
dimensional linear subspaces. For fixed /* the latter can be solved with 
arbitrary accuracy in polynomial time [5,6]. The algorithm is based on an 
approximation of the /*(/* — l)-dimensional Euclidean unit ball by some 
suitable polytope. The facet hyperplanes of the approximating polytope lead 
to linear objective functions; hence linear programming can be applied to 
approximate the optimal value of the original convex quadratic maximiza- 
tion problem. (For a detailed study on this approach and various related 
complexity results see [8, 7, 1,3].) Here we use only a linear number of linear 
programs. 




328 



Note, that this relaxation ignores the integrality conditions. However, 
it can be shown for the Optimization Problem that all but at most 2/* 
coordinates of any vertex of the underlying polytope that maximizes a linear 
objective function are already integer. This leads to at most /* remaining 
lots that can then be easily post-optimized. 

3 Computational Results 

The algorithm sketched above is already in practical use. To illustrate its 
performance we present the results for two regions in Northern Bavaria, with 
5(13) participating farmers cultivating a total of 306 (861) lots with an overall 
size of approximately 331 (436) hectares in the first (second) region 4 . These 
numbers can be seen as quite typical for many other regions, particularly in 
Franconia and Swabia. 

Recall, that our model is motivated by the aim of minimizing driving 
distances. Depending on the time needed to cultivate each single lot the 
relevant measure could be anything between the (weighted) length of a star 
rooted at the farmhouse or the length of a minimum traveling salesman tour 
from lot to lot. For computational simplicity we actually compute for each 
farmer / a minimum spanning tree in the complete graph Gf in the Euclidean 
plane whose vertices are the centers of the lots assigned to /. Denoting by 
t(f) the length of a minimum spanning tree in Gf , we take 

r 

r = X>(/) 

/= 1 

as a measure for the total length of driving distances. 

Recall that in order to relax the problem to linear programming we have 
to approximate the /*(/* — l)-dimensional unit ball (i.e., dimension 20 in the 
first example, 156 in the second) by a polytope. Figures 1 up to 3 depict the 
status quo and solutions obtained by means of random approximation and 
by a Hadamar d-matrix based approximation in the first example. 5 Here the 
random polytope P r is created by choosing uniformly at random 40 points c 
from the 20-dimensional unit sphere and adding the constraints c T x < 1. In 
the Hadamar d-matrix based approximation we use the columns (and their 
negatives) of a (16 x 16)- and a (4 x 4)-Hadamard-matrix to (deterministically) 
construct a 40-facet approximating polytope. 

Figures 4, 5 and 6 depict the status quo and the solutions obtained by 
means of random approximation and approximation based on Hardamard- 
matrices for our second sample region, respectively. 

4 Because of the data protection act we give information only as specific as needed 
for the purpose of this paper. 

5 The original multicolor figures can be viewed under http://www- 
m9.ma.tum.de/dm/consolidation/ OR2003 
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The quadruple (a,b,c/d) given with the figures indicates the relative in- 
crease (percentage) of the square of the Euclidean norm (a) , the relative de- 
crease in T ( b ), respectively, while c and d are tight lower and upper bounds 
for the relative loss/gain of farmsize in the worst case. 




Fig. 2. Random polytope solution: (1074.4;-42.7;-0.37/0.77) 




Fig. 3. Hadamard matrix solution: (850.49;-42.6;-0.66/1.07) 




3 
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A Bipartite Graph Simplex Method 
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Abstract. We introduce the data structure of a rooted, alternating, labelled tree 
and show its utility for a combinatorial solution of the weighted stable set problem 
in bipartite graphs via linear programming. As a by-product we obtain a weighted 
max-min relation. We illustrate the algorithm on grid graphs and present compu- 
tational results that indicate the efficiency of our method. 



1 Introduction 

An undirected graph T=(V,E) without cycles is a forest and a connected 
such graph is a tree. If one of the vertices, say r, is distinguished, we speak of 
a rooted tree. In a rooted tree there is a unique path p(x,y) between any two 
vertices x and y, and we are particularly interested in those paths which con- 
nect the vertices to the root. The length (in number of edges) of such a path 
p(x,r) gives us the distance of x to r. The vertex set V of a rooted, alternating 
tree partitions into V w and V*>, the set of (white) vertices at even, and the 
set of (black) vertices at odd distance from the root. Also observe, that both 
these vertex sets are stable , i.e. no two of their members are joined by an 
edge. Finally, we let N(x) denote the neighborhood of vertex x within T for 
any x. A classical problem in combinatorial optimization is the weighted sta- 
ble set problem (P) in a graph G=(V,E): given a weight function c : V — ► IR, 
find a stable set of maximum total weight. In this paper, we are interested in 
solving this problem for bipartite graphs. The idea is to adapt the simplex 
method to exploit the special structure of (P) similar to the network simplex 
method (cf. Dantzig [3], Cunningham [2] or Ahuja, Magnanti, Orlin [1] for a 
comprehensive presentation). We just recall that the formulation of network 
flow problems as linear programs involves the vertex-arc incidence matrix of 
the underlying network, which is well known to be totally unimodular. The 
formulation of (P) as a linear program makes use of the edge- vertex incidence 
matrix of the underlying graph. In our case, this matrix is also totally uni- 
modular, and this property even characterizes bipartite graphs. It happens 
that problem (P) can be converted into a network flow problem, but in view 
of its structural properties we felt that a more direct method for the solution 
of (P) could be developed. It turns out that rooted alternating trees become 
a very useful tool, in particular in their labelled form: a rooted, alternating 
tree T=(V,E) is labelled if the vertices are labelled with integers c v and the 
edges with integers 7r e as obtained by the following procedure: 
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Edge labelling: 

i) initialize 7 r^- to 0 for all ij G E. 

ii) Starting from any vertex i add and subtract alternately c* from 7r jk along 
the edges jk of the unique path from i to the root. 

iii) Label the root with the value c r :== c r — J2jeN(r) ^ rj • 

We just mention that rooted trees have applications in various fields, espe- 
cially in computer science and operations research. We also think that the 
interest of such trees is not limited to bipartite graphs: since the latter form 
a special class of perfect graphs, an appropriate generalization of these trees 
might help to formulate a combinatorial algorithm for solving problem (P) 
in perfect graphs. Let us explain our approach by a small example. Fig. 1 
exhibits a tree, in which the c r is indicated as the root’s second label: 



2, 1 




3 15 4 

Fig. 1. A rooted, alternating, labelled tree 

A closer look at this example shows the following: 

a ) T, j€ N(i) Kij =CiVieV\r. ~ 

b) Some of the 7 are < 0 and c r = 1 . 

c) The total weight of V w is 15 and that of Vi equals 14. 

2 



3 15 4 

Fig. 2. The same tree with c r < 0 and a negative edge label 

Now let us look at Fig. 2, in which we have interchanged the black against 
the white vertices, chosen a new root among the white ones, recalculated one 
edge and one root label. V& is now of total weight 15, but we can still do 
better, and this is due to a negative edge label: deletion of the corresponding 
edge and another root change leads us to the forest represented in Fig. 3: we 
observe that vertex set V& is now of total weight 17 and it is even of maximum 
weight: c ri and c r2 are < 0 and the edge labels are all > 0, which is nothing 
but the optimality certificate of the simplex method. 
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2, -2 




Fig. 3. The optimal forest 



This paper is organized as follows: we continue to explain the relationship 
with linear programming by giving an interpretation of the corresponding 
simplex tables in purely graph-theoretic terms. In section 3 we present the 
general algorithm (illustrated on a grid graph in the appendix) together with 
a general max-min relation that follows in a straightforward way. Section 4 
is on computational experience as obtained from an implementation of our 
algorithm in C (cf. [4]) applied to a series of randomly generated problem 
instances over grid graphs. We conclude with some remarks on future work. 

2 Bipartite Graphs and the Simplex Method 

Given a bipartite graph G=(V,E) we can formulate problem (P) as the fol- 
lowing linear program 

{ maximize c T x 
subject to Xi + Xj < 1 Vij G E 
Xi > 0 Mi e V, 

or written in standard form 

{ maximize c T x 

subject to Xi -f Xj 4- yij = 1 Mij G E 
Xi and yij > 0 Mi G V and ij G E. 

Throughout the following we will use the slack variables as variables on the 
edges of G. It is well known that any basic feasible solution of (LPS) corre- 
sponds to a stable set in G and vice versa, and therefore, (P) can be solved 
by the simplex method. Also, for an efficient implementation only graph- 
theoretic concepts should be used: the notion of a rooted, alternating, labelled 
tree, and more generally, that of a c-spanning forest is such a concept: 

Definition 1 Given a bipartite graph G=(V,E) together with a weight- 
function c : V — ► IR, a c-spanning forest F in G is a collection of 
(vertex disjoint) rooted , alternating, labelled trees Ti — ( V^Ei ) with 

Vi C V,Ei C E for i — 1 such that every vertex v of G is con- 

tained in one of the Vi and no two vertices at odd distance from their root 
are connected in G. F is called feasible, if all edge labels i Tij are positive and 
all root labels c r non-positive . 
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We just recall from our introductory example that vertices with non-positive 
weight can be treated as single roots, and that for the non-roots we have 
J2j€N(i) 7r ij ~ C i' 

Observation 1 If c is the \V\ -vector of all ones , a feasible c- spanning forest 
coincides with a minimum size vertex cover. 

One can show by induction that the simplex method applied to (LPS) will 
produce a series of simplex tables that are all of the same general form (as 
depicted in Fig. 4): the current basis B partitions into a vertex set Vb and an 
edge set Eb , and the corresponding variables can have values 0 or 1. The non- 
basic indices (with their variables at value 0) are either roots or edges; the 
last line contains their reduced costs and negative edge labels, respectively. 
Also note that the paths starting at a basic vertex or edge are represented as 
(+l,-l)-alternating sequences of edges, the first being labelled +1. 




Fig. 4. A related simplex table ST in general form 



Obviously, the simplex table associated with the initial basis of (LPS) is of 
the required form: it simply reduces to the lower half of table ST. To see how 
these tables change there are 4 possibilities for a pivot step: 

- a root enters the basis and a vertex (resp. edge) leaves it (type 1 resp. 2), 

- an edge enters the basis and a vertex (resp. edge) leaves it (type 3 resp. 4). 
Examples for these 4 types are the following: 

- a root interchange, - connecting 2 trees by an edge to form a single tree, 

- deconnecting a tree into 2 new trees and - the modification of edge labels 
along a cycle. 

It is not difficult to show the following 

Theorem 1 The tables encountered during the solution of (LPS) by the 
simplex method are all of the general form as represented in Fig. f. 

And since pivoting preserves total unimodularity, we also have 
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Observation 2 The coefficient matrix of such a table is totally unimodular. 

It is also straightforward to see how a c-spanning forest can be associated in 
a unique way with a simplex table ST: for this observe that any basic vertex 
is associated in a unique way with a root. Together with possibly isolated 
roots this provides a partition of V into Vi, • • • , V m . The corresponding trees 
can now be reconstructed by use of the paths given for any basic vertex: the 
trees are alternating because a non-basic edge is always incident to a basic 
vertex at value 1 and to another vertex at value 0. Finally, we can determine 
the edge labels for any tree by using the (~bl,-l)-sequences associated with all 
paths and the corresponding vertex weights (cf. our introductory example). 

3 The Algorithm 

The input to our algorithm is a c-spanning forest F that we maintain through- 
out the execution. Recall that at any stage YjeN(i) ~ c * f° r an y b as i c 
vertex i, which implies that YijeE ~ Yiev b c i > t°t a l weight of V& that 
we are aiming to maximize. As soon as the reduced costs are non-positive 
and the edge labels non-negative, by linear programming duality the set V& 
is of maximum weight. For combinatorial reasons we may eliminate all edges 
with 0-label at the end of the procedure, and for notational convenience we 
call a vertex (edge) whose variable is basic and at value 0 or 1, a 0(or 1 ) -basic 
vertex (edge). 

Bipartite Simplex 

Phase 1: Roots 

1. If all reduced costs are non-positive, goto Phase 2. 

Choose a root r with corresponding tree T r for which c r is maximum. 

2. Check whether there is a 0-basic edge connecting a vertex at value 0 of T r 
to a 1-basic one of another tree T r r. 

2.1. there is no such edge: 

- if T r consists of a single root color it black, connect it to a 0- vertex of T r t by 
a non-basic edge and revise the edge labels on p(r,r 5 ) by alternately adding 
and subtracting c r ; set Z r > :=c r > — c r , and make all basic edges incident to r 
0-basic. 

- otherwise exchange the black vertices in T r against the white, choose a 
neighbor r’ of r as the new root, set 7iy r / 7r rr / 4- c r , c r > := — c r and make 
all 1-basic edges incident (with one vertex) to T r 0-basic and vice versa. (We 
have augmented the objective function value z by c r .) 

2.2. there is such an edge: 

make it non-basic and the root r a 0-basic vertex; revise the edge labels along 
p(r,r’) by alternately adding/subtracting c r and set c r > := c r > + c r . (T r and 
T r t have been connected to form a new rooted, alternating, labelled tree with 
higher reduced cost.) Goto 1. 
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Phase 2: Edge labels 

1. If all edge labels are positive, STOP. 

If there is no edge label with negative value, goto 3. 

Choose an edge ij with minimum 7 r^; let T be the associated tree rooted at 
vertex r. 

2. Make ij 0-basic to create two subtrees Ti and Tj\ let i be at 0- value. 

2.1. r is in Tf 

make i the new root of Ti and set c$ := 7 r^-. In Tj , revise the edge labels on 
p(j,r) by alternately adding and subtracting 7 r^-; set c r :=c r — 7 If c r > 0 
goto Phase 1. Else goto 1. 

2.2. r is in T 

revise the edge labels on p(i,r) by alternately adding and subtracting 7 r^- 
and set c r := c r + 7 r^*. In Tj choose a neighbor r’ of j as the new root, set 
. — 7Tij and 7Tjp f . — 7r jpf "l - 7Tjj . Goto IPhase 1. 

3. (Optional) Make ij 0-basic to create two subtrees Ti and Tj ; let i be at 
0- value. If r is in Tj, make i the new root of Ti and set Ci := 0. If r is in T*, 
choose a neighbor r’ of j as the new root of Tj and set c r / := 0. If all edges with 
0-label have been deleted, STOP. Else choose another such edge ij and goto 3. 

The validity of the algorithm follows from the fact that the basic operations 
(steps 2.1, 2.2 of Phase 1, and steps 2, 3 of Phase 2) have an immediate 
interpretation as pivot steps (of type 1, 2 for steps 2.1, 2.2 of Phase 1, and 
of type 3 for steps 2, 3 of Phase 2). Moreover, since at every step either the 
objective function value or one of the reduced costs increases by a positive 
value, our algorithm is certainly finite. However, we are not able to indicate 
a firm complexity bound: the deletion of a negative edge label may, for exam- 
ple, engender new negative edge labels. This behavior strongly resembles the 
network simplex method, cf. [2]; the computational results to be presented 
in the next section indicate the efficiency of our method in a similar way. As 
a by-product we obtain the following max-min relation: 

Observation 3 In a bipartite graph the maximum weight of a stable set 
equals the weight of a feasible c-spanning forest. 



4 Computational Experience 

The tests have been run under Linux on a Pentium III 500 MHz with 256 
MB of RAM, and our algorithm has been implemented as a 1000 lines C 
code compiled with the -04 option of GNU gcc (cf. [4]). The test problems 
are grid graphs of size pq with vertex weights randomly chosen within the 
range [1,100]. Table 1 reports the running times (in milliseconds) compared 
with those obtained with the LP-solver LP-SOLVE in its version 3.2. 

These results clearly indicate the superiority of our algorithm. A comparison 
with other LP-solvers (such as SOPLEX or CPLEX) is under way: first results 
indicate a 50 % - superiority of our algorithm over SOPLEX. 
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Table 1. Bipartite Simplex vs. LP-SOLVE 



p 


q 


vertices 


edges 


Bipartite Simplex 


LP-SOLVE 


45 


45 


2025 


3960 


486 


4736 


55 


55 


3025 


5940 


1054 


11081 


65 


65 


4225 


8320 


3087 


26775 


75 


70 


5250 


10355 


4121 


39538 


65 


85 


5525 


10900 


6044 


46941 


80 


80 


6400 


12640 


8512 


68916 


90 


90 


8100 


16020 


14256 


110052 


100 


100 


10000 


19800 


23659 


177528 



5 Conclusions 

We already mentioned the interest of a suitable generalization of rooted, al- 
ternating, labelled trees for the class of perfect graphs, and the design of 
a perfect graph simplex method along the same lines (involving the associ- 
ated clique- vertex incidence matrix). Also note that our trees generalize al- 
ternating paths, and therefore an interesting relation with matching- (and 
augmenting path-) theory should exist. Another direction to follow would be 
to specialize our algorithm to solve problem (P) over planar grid graphs or 
trees, possibly within firm complexity bounds. One could also think of using 
these methods to approximate optimal solutions of problem (P) over more 
general graphs. Finally, the study of different pivot selection rules and other 
implement ational aspects should lead to computational improvements. 
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6 Appendix 

We are now going to illustrate our algorithm on a grid- graph of size pq , 
i.e. a graph whose pq vertices are arranged to form a rectangle of p lines 
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and q columns, two vertices being connected if they are at euclidean unit 
distance. These graphs are easily seen to be bipartite; they are planar, too, 
and therefore our results are also interesting for solving stable set problems in 
planar graphs. Fig. 5 exhibits such a graph of size (4,6), with integer weights 
attached to the vertices. At this initial stage, all vertices represent roots, 
whose weights coincide with the reduced costs, and all edges are 1-basic. 

3 2 4 7 6 g 

P P P P P P 

; 6 i 3 ; 1 ; 5; i 

5 g. p- p- p- p- P 4 

i 6 i 8 i 9 i 2 i i 

2 g- p- p- p P- p 1 



Q- □- □- □- D- □ 

4 2 4 3 5 

Fig. 5. A weighted grid graph 



For convenience we represent the (non-basic) roots by white squares and the 
0- and 1-basic vertices as white and black vertices, respectively, to which the 
weights and reduced costs will be attached. Edges will be black (if non-basic) 
with their labels attached, or dotted (0- or 1-basic); in Fig. 6 a 1-label is 
attached whenever such an edge is 1-basic. After having obtained the non- 
positivity of all reduced costs two negative edge labels remain to be treated 
(involving step 2.2 of Phase 1). The final, optimal solution is given in Fig. 6. 
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Abstract. In this paper we investigate parametric optimization problems of the 
form inf{.F(x) — p T x : Ax <6, x G Z n } with F : R n — > R being differentiable 

X 

and convex and p G R n being some parameter. For this problem we consider the 
regions of stability, i.e. we ask for the set R(x°) of all parameters p for which a 
given feasible point x° is optimal. Of special interest will be the conditions under 
which the sets are bounded or polyhedral. 



1 Introduction 

In the following we want to consider parametric optimization problems of the 
form 

f f(x, p) = F(x) - p T x -»min 
< * (1) 
| s.t. Ax < b, x G Z n , 

where b G R n , A e R mxn and p G R n is a parameter. The function F : R n — > 
R is supposed to be convex and differentiable on R n . 

Let Sp> := {x £ Z n : Ax < b} denote the set of all feasible points. 

Definition 1. Let x° E Z n a feasible point. Then the set 

R(x°) = {p e R n : f(x°,p) < /(x,p) for all x G Sd} 

is called region of stability for the point x°. 

Thus the set R(x°) denotes the set of all parameters for which the point 
x° is optimal. Let us consider the following example. 

Example: 

' f( x iP) — b xT x — p T x — > inf 

z X 

—X\ + X2 < 3 
< Sxi 4- X2 < 15 
- x 2 < 3 

, — 3xi — 2x2 < 9 , x G Z 2 

We want to describe the regions of stability for all x G Sd- In this example 
the regions of stability partition the parameter set as shown in figure 1. 

The sets R{x) have some interesting properties in this example. For all 
x G Sd the regions of stability are convex polyhedra and R(x) is bounded iff 
x G int conv S d • 
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2 First Results 

Up to now regions of stability have been investigated mostly for integer linear 
optimization problems ([2], [3]). Further for a more general objective function 
they were proved to be convex and closed ([4]). We will consider functions of 
the form /(x,p) = F(x) — p T x where F : R n — > R is supposed to be convex 
and differentiable. For information about (strict /strong) convexity we refer 
to [1]. First we want to give some auxiliary results. 

Let x° £ Sd- Then for all p £ R(x°) it holds 

F(x°) —p T x° < F(x) —p T x Vx £ Sd 

F(x) > F(x°) + p T (x - x°) Vx £ S D (2) 

p T (x — x°) < F(x) — F(x°) Vx £ Sd • 

Lemma 1. Let x° £ Sd- Then 

1. R(x°) corresponds to the intersection of (maybe infinitely many) half- 
spaces. 

2. Ä(x°) is convex and closed. 

This lemma is an easy consequence of the inequalities (2). Now we get the 
following simple conclusion. 
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Corollary 1. Suppose the set Sd has finite cardinality. Then the set R(x°) 
is a convex polyhedron for each x° G Sd- 

Lemma 2. Let x° e S&. Then VF(x°) G R(x°), i.e. R(x°) ^ 0. 

This can easily be proved using inequalities (2). Further, for this result 
the special form of /(x,p) is necessary. If /(x,p) has an other form or if F(x) 
is not convex then R(x°) = 0 can hold for some x° G 

Examples: 

1. / ^ ~ * It holds i?(l) = 0 since p 2 + 1 > 0 for all 

( —x 2 — px — > min 
\0<x<2, x eZ 

In this example the function F(x) = — x 2 is not convex. The regions of 
stability are i?(0) = (— oo, —2], R( 1) = 0 and R( 2) = [—2, oo). 

Lemma 3. Suppose F : R n —> R is strongly convex and Sd ^ 0- Then the 
following holds: 

1. inf f(x,p) > — oo Vp G R n 
xESd 

2. Vp G M n 3x° G with inf f(x,p) = f(x°,p) 

x£Sd 

^From this lemma it follows that for each parameter p G R n there exists 
some x° E Sd with p G i?(x°). In the following example we will show that 
this does not hold in general if F is only strictly convex. 

Example: Let be given the problem 

{ /(x,p) = e x — xp — » inf 
xgZ 

Then it holds inf f(x,p) = — oo if p < 0. For p = 0 it holds inf /(#, 0) = 0 
x£Sd xez 

but there exists no optimal solution. 

3 Boundedness and Dimension of the Regions of 
Stability 

Theorem 1. For each x° G Sd the set R(x°) is bounded (and therefore 
compact) iff x° G intconvSp. 

Proof Suppose R(x°) is unbounded for x° G Sd • Since VF(x°) G R(x°) 
and since R(x°) is convex and closed there exists some h G R n , h ^ 0 with 
VF(x°) + oth G R(x°) for all a > 0. Thus it holds 

F(x) > F(x°) + (VF(x°) + ah) T (x - x°) \/x G S D 
F(x) > F(x°) + VF(x°)(x — x°) + ah T (x — x°) Vx G Sd • 
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If h T (x — x°) > 0 for some x G S& then for a > oy ' '' ^ ^ ' the 

above inequality would not be fulfilled. Thus we obtain h T (x — x°) <0 for 
all a: G S&, i.e. there exists some supporting hyperplane at x° to conyS#. 
Therefore x° £ intcon vSp. 

Suppose x° £ intconvSx>. Then there exists some h G R n , ft ^ 0 with 
h T (x — x°) < 0 \/x G S&. Since the function F is convex it holds for all 
x G S D 



F(x) > F(x°) + \7F(x°)(x - x°) 

> F(x°) + VF(x°)(x — x°) + ah T (x — x°) Va > 0 
= F(x°) + (VF(x°) + ah) T (x - x°). 

Thus, (VF(x°) + ah) G R(x°) Va > 0, i.e. R(x°) is unbounded. 

Theorem 2. Let F : R n — ► R be strictly convex. Then it holds VF(x°) G 
intjR(x°) for all x° G S&, i.e. all regions of stability have dimension n. 

Proof. Let us assume VF(x°) £ int R(x°). Then there exist sequences 
{p k } — ► p° = VF(x°) and {x k } C So with f(x k ,p k ) < f(x°,p k ). Let 0 < <5 < 
1 < \\x k — x°|| Vfc and let z k = akX k + (1 — ak)x° with — 5/ \\x k - x°\\ Vfc. 
Then it holds \\z k — x°|| = ak\\x k —x°\\ = 5 and z k G S = {x G R n : Ax < b}. 
Thus, {z k } has some limit point z* e S with \\z* — x°|| = S > 0. Let w.l.o.g. 
lim z k = z*. Then it holds 



= lim f(z k ,p k ) < lim f(x°,p k ) = f(x°,p°) 

k — »Go k—* oo 



since 

f(z k ,p k ) = f{a k x k + (1 - a k )x°,p k ) < a k f(x k ,p k ) + (1 - a k )f(x°,p k ) 

< f(x°,P k ). 

Thus, F(z*) < F(x°) + VF(x°)(z* — x°) which is a contradiction to F being 
strictly convex. 

4 Statements on Polyhedrality 

Theorem 3. Let R(x°) be bounded for some x° G Sp and suppose F : R n — > 
R to be strongly convex. Then the set R(x°) is polyhedral. 

Now we may question whether R(x°) is polyhedral for all x° G 5p. In the 
following example will show that this does not hold in general. We will need 
the additional restriction that the matrix A is rational. 

Example: 

j \x T x — p T x —> inf 
1 Xi < V2 x 2 , x G Z 2 
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Since y/2 irrational x = 0 is the only feasible point, which lies on the line 
= y/2x2- Therefore the regions of stability for all feasible points unequal 
zero are polytops. The set R( 0) is unbounded but not polyhedral. 

Further we will need the following lemma: 

Lemma 4. Let be given some set Sd = {x £ Z n : Ax < b} with A £ Z mxn 
and b £ Z™ . Then there exists some finite subset V = {u 1 , . . . , C 5 d\{0} 
N 

with Sp C {x = OL i v% : a i € i = 1, . . . ,N}. 

i= 1 

Proof. We define a subset U £ z+ n+m as follows 

U :={(b-Ax,x+,x~) : x £ S D \{0}}. 

Then the Gordan lemma [5] tells us that there exist elements v 1 , . . . ,v N £ 
Sd\{ 0} such that for every element of x £ Sd\{0} there exists an index 
i £ {1, . . . , N} with (b — Ax, x + ,x~) > (b — Av l ,v l ). We claim that 
v 1 , . . . , v N have the required property. 

To see this, let x £ S£>\{0} and x £ {u 1 , . . . ,v N }. Then there exists an 
index i £ {1, . . . , iV} with (b — Ax, x + ,x~) > (b — Av % , , v % ). It follows 

that x — v l is integral and that 

A(x — v l ) = (b — Av l ) — (b — Ax) < 0 < b. 

Hence x — v % £ Sd\{ 0}. Repeating these arguments with x — v l instead of x 
and noting that \x — v % \i < \x\i we obtain after a finite number of repetitions 
of this process a nonnegative integer representation of x. 

Theorem 4. Suppose the matrix A is rational and F : R n — » E is strongly 
convex. Then R(x°) is polyhedral for all x° £ Sd- 

Proof. Let be given some x° £ Sd- Further let be e £ {— 1, l} n and 

§ £ := {x £ Sd : (x< - >0 Vz = 1, . . . , n}. 

Since the matrix A is supposed to be rational the set 

T £ := {x — x° : x £ Z n , A(x — x°) < ( b — Ax ° ), {xi—x^Si > 0 Vi} = § £ — x° 

is a rational polyhedron. Thus from lemma 4 it follows that there exist vectors 
v 1 , . . . , v N £ T e with 

N 

T e C € Z+, i = 1, . . . ,iV}. 

t=i 

Obviously z; 1 + x°, . . . , v N + x° are elements of S e . Thus R(x°) is a subset of 
the polyhedron 



P := {p £ R n : + x°) > F(x°) + p T v\ i = l,...,N}. 
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Further, some x G § £ is only needed in the description of R(x ° ) if the hyper- 
plane p T (x — x°) = F(x) — F(x°) is cutting the polyhedron P, i.e. if there 
exists some p G P with F(x) < F(x°) + p T (x — x°). 

Suppose x e Sd is such a point. Then there exist numbers ai, . . . , G 
N 

Z_j_ with x = x° + Yl a i vl and the system 

i=l 



' v^p < F{v l + x°) - F(x°), i = 1, . 
(x — x°) T p > F(x) — F(x°) 



, N 



( 3 ) 



is solvable. From this follows by a theorem of the alternative that the system 

z G , u G R+, u ^ 0 



N 



E z % v% — u i( x — x ° ) — o 



N 



i= 1 



( 4 ) 



E (Fiv* + x°) - F(x°))zi - Ml (F(x) - F(x 0 )) + u 2 = 0 

i = 1 

is not solvable. Thus for u\ = 1 the following system is also not solvable 

N 

E — x — x° 

i= 1 

E (*V + x °) - F(x°))zi < (F(x) - F(x 0 )) 

i= 1 

zeR*. 



N 

Since x = x° + E a i yl we get for Zi = a*, i = 1, . . . , TV 

i=l 

N 

^otiiFiv* +x°) - F(x 0 )) > F(x) - F(a; 0 ). 

i=l 



Then we obtain 

AT 

^ a i (F(v < + x°) - F(x 0 )) > F(x) - F(x°) 

i— 1 

> VP(x°)(x — x°) + 6\\x — x°\\ 2 

N N 

J2ai(F(v i +x°) - F(x°) - VP(x°K) > 0^a 2 |H| 2 . 

i= 1 i=l 

Let be z/ = min \\v l \\ 2 > 0, a = (au, . . . , ajv) T and d — (c?i, . . . ,djv) T with 

z=l,...,iV 

di := F(v* + x°) - F(x°) - VF(x°)v\ i = 1, . . . , N. Then it holds 
IHINI > HNI 2 , i.e. ||a||<M 
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N 

Thus Vx = x° + ]T a iV l with (x-x°) T p > F(x) — F(x°) for some p e P there 

i= 1 

i s IMI < ^7- Therefore there are only finitely many x 6 § £ for which system 

(3) is solvable. Since Sd = U £ § £ this implies that R(x°) can be generated by 

finitely many elements of S#, i.e. R(x°) is polyhedral. 
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Abstract. This paper deals with the containership stowage problem. Containers 
are placed on the ship in a last-in-first-out manner and therefore temporary unload- 
ing and reloading in subsequent ports along the route, called shifting, is common 
and results in high costs. This is true, in particular, if the stowage plan is based 
only on stability constraints of the ship. 

The generating of such schedules depends on the transportation load, the technical 
constraints and possibilities in the ports, the ship geometry, the sequence of ports 
visited and some other rather technical constraints (e. g. very heavy containers or 
hazardous goods). 

We will show how this containership stowage problem can be modeled as a mixed 
integer programming model and discuss the computational complexity of the prob- 
lem. Based on these results, solution methods are developed and some special cases 
are analyzed. 

Furthermore, as a cross reference, we draw our attention to other combinatorial 
problems like the three-dimensional packing problem with special precedence con- 
straints or pile-up problems. Finally, we propose possible directions for further 
research. 



1 The Containership Stowage Problem 

Containerships call at many ports and at each port containers are loaded and 
unloaded. The containers on board of a containership are put into stacks. A 
container is only accessible if it is on the top of the stack (last-in- first-out). 
The task of determining a good container arrangement is called stowage plan- 
ning, e.g. [1]. Because modern containerships carry up to 7000 containers and 
visit up to 20 ports, optimization requires solution of a large scale combinato- 
rial problem. To come up with a good stowage plan there might be multiple 
objectives that could be pursued. We attempt to minimize the container 
shifts, but there are other objectives as well like (see [14]): 

• minimizing usage of ballast water, 

• minimizing torsional and shear forces, 

• maximizing utilization of the terminal equipment, 
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• minimizing trim, 

• effective hatch usage. 

In addition to the accessibility constraint named above, a huge set of other 
constraints, such as maintain ship stability, requirements for the storage of 
hazardous cargo, deck strength limits, electric supply of refrigerated units, 
and limited mixture of 20’ and 40’ containers. 

Also, there are some more limitations for the container terminal and in gen- 
eral the loading of a ship begins before all containers to be shipped have 
arrived. This makes the problem stochastic and results in several updates of 
the stowage plan. 



2 Basic Model 

In the basic model (as given e. g. in [4]) the containership is modeled as a 
single bay as an array with R rows (heigth of stacks) and C columns (total 
number of stacks). There are N ports. The ship starts with an empty bay at 
port 1 and at port N all containers will be unloaded. The placement of the 
containers remains unchanged between port i and port i + 1 . We call the bay 
uncapacitated if R = oo, capacitated otherwise. 

The transportation load is given as a (N — 1) x (N — 1) matrix T = (T^), 
where Tij is the number of containers orginating at port i with destination 
j. There is one standard size of container, which can be placed on arbitrary 
positions in the shipbay. The transportation load should be feasible in respect 
of hold and deterministic at every port. 

There is one crane at every port which can lift any container on the quay 
and on the bay without limitations. All containers orginating in that ports, 
respectively, have arrived before the ship. The shifting cost per container is 
equal to 1. 



Definition 1 ([1]). A container u of a column is overstowed when it blocks 
the retrieval of another container v and the destination port j of u is later 
on the schedule than the destination port i of v. 

If there are overstowed containers shiftings become necessary, i. e. to tem- 
porarily unload the containers and reload them later. 

Definition 2 (uCSP). Given a transportation matrix, a bay, and a nonneg- 
ative integer s, the unrestricted containership stowage problem (uCSP) is the 
decision problem if there exists a stowage plan that cause at most s shifts. 
Associated optimization problem is to minimize shifts. 

The term ’’unrestricted” means, that there are no technical restrictions to be 
considered in a sense that each container can be placed in any empty slot. 
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Theorem 1 ([4]). Let C be the number of columns in an uncapacitated bay. 
Then , the uncapacitated, unrestricted containership stowage problem is MV- 
complete for C > 4. 

There are some special cases. Clearly every bay with N — 1 uncapacitated 
columns can result in a zero-shifts plan for every transportation matrix, but 
it can further be reduced: 

Theorem 2 ([4]). Let T be a (N — 1) x (N — 1) transportation matrix with 
no zero entry on or above the diagonal. Then the minimum number of unca- 
pacitated columns C* needed for a zero- shifts plan to exist is equal to 

The common formulation of the uCSP is (see in [2]): 

N-l N R C j-1 

Min Yl YYYY ^( r > c ) 

i = 1 j=i + 1 r=l c=l v=i + 1 

subject to 

Shipquant (i = 1, . . . , N — 1, j = i -f 1, . . . , N): 

R c j i-l r c 

Y Y Y x » v ( r > c ) _ YY Y Xk ^ ( r > c ) = Ti i (!) 

r=l c= 1 i>=z+l /c=l r=l c=l 

Slot (i = 1, . . . ,N — l,r = 1, . . . , R, c = 1, . . . , C): 

i N j 

Yj Y x k]v(r,c) = y t (r,c) (2) 

k= 1 j=i + 1 v=i + 1 

OnTop (i = 1, . . . , N — l,r = 1, . . . ,R — l,c = 1, . . . ,C): 

yi(r,c) - yi(r + l,c) > 0 (3) 

Shift (j = 2, . . . , N, r = 1, . . . R — 1, c = 1, . . . , C): 

j — 1 N j—lNp 

YY Xipj (r , c) + E £ £ x lp „(r + l,c)<l (4) 

^=1 «=1 P=J + 1 V=J + 1 

(X i c)e{0, 1} Vi{r,c)e{ 0,1} 

We define Xij v (r, c) = 1 if there is a container in slot (r, c) loaded on board 
in port i with final destination j, and unloaded in port v and 0 otherwise. 
Furthermore yi(r,c) = 1 if upon sailing from port i , slot (r, c) is occupied by 
a container and 0 otherwise. 

The constraints allow for the following interpretation: (1) specifiy the number 
of containers to be shipped. (2) ensure that there is at most one container in 
each route segment. (3) are needed to ensure that the containers are stored in 
stacks and (4) define shifting movements. The objective counts the shiftings 
caused by overstowed containers. 

Other formulations of the CSP as a mixed integer program can be found in 
[5] and in [11], but there are even more variables and constraints in use. 
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3 Extensions of the Basic Model 

There are a lot of potenial expansions of the basic model, in particular with 
regard to technical constraints. For example, heavy containers should be 
loaded in the columns first. Or the containers which need electricity have 
to be stowed separately. 

Different costs of container movements in ports can be incorporated intro- 
ducing weigths into the objective function. 

The provision for the ship geometry can be carried out through the usage 
of virtual containers to be unloaded in a port N 4- 1 or an appropriate data 
structure other than a matrix for the bay plan. 

Conspicuous it is that stowage plans generated on the basic model tend to 
group containers with the same destination. This is certainly a plausible way 
if there is only one crane at a terminal. But it might be unfavorable in cases 
where more than two cranes are available because the grouped containers are 
only accessible by one crane. 

In [12] an integrated approach which combines stowage planning and selection 
of loading sequences of the quay cranes is presented. Especially the just-in- 
time arrival of containers at the terminal is modelled. 

In all cases mentioned above the basic model is not suited without arranging 
columns in two dimensions. 

We augment the approach in that we include several additional constraints 
and we examine how given solution methods and data structures have to be 
modified. 

First: Ships are never completely empty. This makes it usually impossible to 
arrange all containers in order leaving the first port. 

Second: Ports visited are not all different as some ports are visited twice, e. g. 
a typical tour between Europe and Asia is calling Shanghai and Hong Kong 
two times. 

Third: Ships make round trips. Therefore the transportation matrix cannot 
be defined as above mentioned as there will be no transports between port i 
and i + N or other pairs. 

4 Solution Methods 

Due to the fact CSP is bfV - complete and the formulations as a binary linear 
program does not provide us with much hope to obtain results in reason- 
able time developing heuristics seems suggestive. There are some methods 
for producing solutions like simulation, heuristics, rule-based expert systems 
and decision support systems. We want to mention here [15] as a good starting 
point. Wilson et al. in [15] and [14] use a two stage process of computerized 
planning i. e. generalized placement strategy as well as specialized placement 
procedures. They incorporate many of the technical constraints in the objec- 
tive function and their procedure models the human planner’s conceptional 
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approach. 

We examined the basic model with our own extensions mentioned above. 
The generation of random instances was conducted in the following way: 
Departing from the empty transportation matrix, a given number of ports, 
and the capacity of the ship generation of the transportation matrix is done 
by adding several transports. Input factors are the number of transports to 
add, and the maximum size for an additional transportation. 

A single transportation is added by selecting a random valid (i, j) combi- 
nation (j > i) and adding containers. The number of containers is set to a 
random value from one to maximum for an additional transportation. If that 
amount of containers can be added to the transportation matrix without ex- 
ceeding the ship capacity, it is done. If not, a new random value is selected 
up to the amount that can be added without exceeding the ship capacity, 
then that new amount of containers is added to the transportation matrix. 
An alternative generation method tries to approximate real world transporta- 
tion problem. Suppose that several ports are given, and the route of the con- 
tainership is given as a string of indices to these ports, let n be the length of 
the route. The container ship is expected to cruise that route several times, 
the generation process approximates this loop on the given route m times. 
The whole journey covers N = n*m ports. 

Further, for example, a ship on a route linking Europe and China is not ex- 
pected to carry many containers for transportation within Europe only or 
within China only, and is not expected to transport containers from Europe 
to Europe via China. Such restrictions are implemented with a port to port 
matrix containing weighting factors for each combination of source and des- 
tination port for the given route. 

As with the simple generation of the transportation matrix, a number of 
transports are added to this matrix. A new transportation is selected with 
a random starting port i E {1, . . . , iV — 1} and a random destination port 
j E {i + l,...,i + n— 1}. The port associated with the indices i and j are 
looked up. If the vessel will reach the destination port after i and before j , 
then no transportation is added. Otherwise a transportation is added in the 
same manner as in the above named simple generation, but using the addi- 
tional weighting factor from the port to port matrix. In case the weighting 
factor is 0, no transportation is added to the transportation matrix. 

The generated instances can be downloaded from the web [8]. 

The stowage plans for all transports steps are build up in parallel by the 
following three steps of our heuristic. The first step assigning whole columns 
(inspired by [2]). All steps start processing transportations with maximum 
distance first. All transportation amount in the transportation matrix T are 
divided by the row height R. The numbers of whole columns a transportation 
can fill are noted for processing in the first step, the remaining transporta- 
tion amount is left in the transportation matrix for further processing in the 
second and possibly third step. 
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At the first step whole columns are filled with containers assigned to the same 
cell for the whole journey. As columns are filled with containers of the same 
source and destination port only, no shifting is necessary. This step always 
succeeds, but can leave some columns fragmented in transportation steps, as 
the column is filled with containers only for some transportation steps but 
not for all. 

At the second step the heuristic tries to fill the remaining containers into 
columns without causing shifts. Containers are assigned to partially filled 
columns containing containers with the same destination and the same or an 
earlier source port. Thus no shifts are created assigning the containers on 
top of the already assigned containers. Otherwise containers are assigned to 
columns empty during the required time, so the container can be assigned 
without the need for shifts. 

Remaining containers are filled in the third step one by one: for every con- 
tainer the best assignment is calculated with a branch-and-bound algorithm 
to minimize shifts necessary to store that container. This algorithm selects 
several time slices, where there is at least one column for every time slice 
with a free cell during the given slice, and the time slices add up to the 
transportation duration of the container to be assigned. Combinations with 
smaller intersections of the time slices are prefered. 

Containers to be shipped from port i to port i + 1 can never cause a shift, if 
these containers are placed last on top of all other containers and are removed 
first. The first and second step do not assign such transportations. 

We compared its results with the suspensory heuristic which was implemented 
according to the outline Avriel et al. [3] . We could improve results. Our re- 
sults are available online at [8]. 

As placement of a column in ship bay is not specified, it is further possible 
to try to meet stability constraints via adjustment. 

5 Related Problems 

In this section we show some other problems connected with the CSP. A 
discussion of Tower of Hanoi problem(see [9] and for an application [10]) or 
sorting permutations by stacks (see [7]) are omitted due to the scope of this 
paper. 



5.1 Tram Dispatching 

In a recent PhD-Thesis [16] the tram dispatching problem is analyzed. In 
this problem it has to be decided how incoming trains have to be distributed 
to tracks in the depot so that no shunting occurs in the next morning. The 
difference to the CSP is that no trains leave the depot before all trains have 
arrived and this difference is crucial. The thesis additionally analyses the 
online case. The online case means just in time changes as crash of trains 
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and delays and are like result changes in the stowage plan if new containers 
arrive to load. So this approach can possibly be adapted to the stochastic 



CSP. 



5.2 Packing with discharge conditions 

The vehicle routing problem with packing constraints was recently presented 
[13]. In this problem, there are some vehicles with dynamic pickup and deliv- 
ery at the customers and the gemoteric load dimensions are also considered 
and not only the total weight or volume of boxes to be picked. The goal is to 
minimize tour length and unutilized volume. 

In a new approach we analyze the loading and unloading operations by each 
delivery. Because the volume of each vehicle is limited and there is normally 
only one access point at the rear, it may be necessary to unload some boxes 
temporarily. These shifts depend on the sequence of the visited customer and 
the packaging pattern. 

In general we consider a three-dimensional packing problem according to 
Dyckhoff’s [6] classification as 3/V/O/C. This denotes a three-dimensional 
packing problem where one large object has to be packed with all items of 
congruent figures. If every item has a destination and there is a certain se- 
quence of destinations it is useful to think about the discharging procedures. 
One can identify two cases: 

In the first case all items have to be loaded in the beginning. Then, the objec- 
tive is to minimize, for example, the unutilized space and to minimize shifting 
operations at each destination by unloading the items. 

The second case is more complicated when loading and unloading occurs at 
every destination as is the case in vehicle routing problems with packing con- 
straints explained above. 

In contrast to CSP, the items are not loaded in stacks and there might be very 
complicated patterns of packed items. The boxes are overstowed in different 
manners, e. g. there are over stowed boxes above but also in front or beside a 
box. Clearly there is only one type of boxes in CSP. 



6 Further Research 

The complexity of the uCSP is still unknown for fixed number of rows R. 
Also it can be shown that for a single uncapacitated column there exists a 
polynomial time algorithm [1], the complexity of the uCSP remains unsolved 
for C = 2 or C = 3. 

There is no application of these models and solutions methods to real data. 
Many solution methods seems to be ad hoc so that a comprising analysis is 
auspicious. 

A new formulation as a mixed-integer program which can be expanded to 
multicriteria objectives would be eligible. 
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Solving the Sequential Ordering Problem 
with Automatically Generated Lower Bounds 
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Abstract. The Sequential Ordering Problem (SOP) is a version of the Asymmetric 
Traveling Salesman Problem (ATSP) where precedence constraints on the vertices 
must also be observed. The SOP has many real life applications and it has proved to 
be a great challenge (there are SOPs with 40-50 vertices which have not been solved 
optimally yet with significant computational effort). We use novel branch&bound 
search algorithms with lower bounds obtained from homomorphic abstractions of 
the original state space. Our method is asymptotically optimal. In one instance, 
it has proved a solution value to be optimal for an open problem while it also 
has matched best known solutions quickly for many unsolved problems from the 
TSPLIB. Our method of deriving lower bounds is general and applies to other 
variants of constrained ATSPs as well. 



1 Introduction 

The Sequential Ordering Problem (SOP) is stated as follows. Given a graph 
G, with n vertices and directed weighted edges with the start and terminal 
vertices designated. Find a minimal cost Hamiltonian path from the start 
vertex to the terminal vertex which also observes precedence constraints. An 
instance of a SOP can be defined by an n x n cost matrix (7, where the entry 
Cij is the cost of the edge ij in G, or it is -1 to represent the constraint that 
vertex j must precede vertex i in the solution path. 

The SOP is a model for many real life applications, ranging from heli- 
copter routing between oil rigs [10] to scheduling on-line stacker cranes in an 
automated warehouse [1]. 

Most asymptotically optimal solvers model the SOP as an Integer Pro- 
gram. Unfortunately the exact structure of the SOP polytope is not yet fully 
understood and therefore these methods achieved only limited success. Our 
approach is state space search. The partial completions of feasible tours form 
a directed acyclic graph. The lower bounds are derived from abstractions of 
the original state space and correspond to optimal tour completion costs in 
the abstract space. The lower bounds are stored in a look-up table which we 
will refer to as the pattern database. They are named so, because the abstrac- 
tion corresponds to merging states of the original state space according to 
some syntactic pattern. The abstraction mechanism described in this paper 
is general and it is applicable to other versions of constrained ATSPs as well. 

* work done at SITE, University of Ottawa, Canada, istvan@site .uottawa. ca 
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2 Related Work 

Optimal solutions to some instances of the SOP were obtained by Ascheuer et. 
al. [2] who used the cutting plane technique. They also employed heuristic 
tour constructions and improvements to derive actual solutions. Escudero 
et al. [5] used a similar approach but the lower bounds were obtained by 
Lagrangian relaxation. 

The HAS-SOP system of Gambardella et al. [6] is a metaheuristic tech- 
nique. In many instances they obtained the best known upper bounds to un- 
solved instances. This approach is a form of stochastic search and therefore 
optimal solutions cannot be guaranteed, however the solutions were obtained 
very quickly. Similar results using genetic algorithms were achieved by Seo 
et al. [11]. 

Christofides et al. [3] considered state space relaxations first to generate 
lower bounds for TSPs. They also used a state representation very close to 
ours. The same approach was also considered by Mingozzi et al. [9] for the 
TSP with time windows and precedence constraints. 

The pattern database technique was invented by Culberson and Schaeffer 
[4] and was later used by Korf [8] to obtain optimal solutions to the Rubik’s 
Cube for the first time. 



3 Lower Bounds 

In our representation, a SOP state s corresponds to a partial completion of 
the tour. It records the current last vertex in this partial tour as well as the 
vertices which have not been reached yet. This is very similar to the state 
representation of Christofides et al. [3]. The SOP state space S is a lattice 
with the start state at the apex and the goal state at the bottom. The lattice 
has n levels, each corresponding to adding a new vertex to a partial tour such 
that it still satisfies the constraints. These levels are manifested by the edge 
structure of the lattice. Edges in S only exist between adjacent levels. 

The abstract state space S f is also a lattice with the same number of 
levels as S. However, \S'\ < |5|, so we can enumerate it efficiently. The 
abstract lattice is obtained by clustering states of S on the same level. Figure 
1 illustrates the conceptual relationship between the original and abstract 
lattices. S is the original lattice and S' is the resulting abstraction. We chose 
states on the same levels to cluster and identified the cheapest cost edges 
entering and leaving these clusters (drawn with bold edges). These edges will 
be retained to connect the clustered states which are now replaced by a single 
vertex (shown as filled circles) in S'. The cost of the optimal completion of s' 
in S' is a lower bound on the optimal completion cost of the preimage states of 
s' in S. This is exactly what our lower bounds correspond to. The abstractions 
are simple relabeling functions we call domain abstractions. Initially we assign 
a unique label to each vertex in the SOP. 0 and n — 1 are the labels of 
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Fig. 1. State Space Lattice Abstraction 



the initial and terminal vertices. A domain abstraction is a map from this 
set of labels to another set of labels of smaller cardinality. We use different 
domain abstractions at different levels. Let us consider two specific examples 
of domain abstractions for a 6 vertex SOP. 



v 0 1 2 3 4 5 

02 (v) 0 112 13 (1) 

0 3 (u) 0 1 2 2 3 4 



02 and 03 are applied to levels 2 and 3 respectively. Let x represent a non- 
existing edge in S and -1 correspond to a precedence constraint as we de- 
scribed earlier. 
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Equation 2 shows how the original cost matrix is transformed into the cost 
matrix C 2 3 that describes the connectivity and costs between S 2 and S' s . In 
order to guarantee lower bounds, the most conservative choice is applied to 
derive the cost representing the merged edges. If all edge costs are -1, then the 
resulting edge cost is also a -1 (precedences can be preserved). If some are -1 
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and some are x we must choose an x (and eliminate some precedences). If all 
preimage edges are x then so is the abstract edge cost (no new edge created). 
If there are some non -1 and non x entries then we must choose the one with 
the minimum cost. In [7], we prove that this construction results in valid 
lower bounds for S. Although conceptually S' is obtained by compressing 5, 
S is so large that it cannot be enumerated and we build S' by expanding it 
from the bottom up while also calculating the lower bounds corresponding 
to the completion costs of the abstract partial tours of S'. For details see 
[7]. To obtain the abstractions, we minimize a user provided error function of 
the merged edges. In our experiments, we found that minimizing the absolute 
error between the merged edge costs and the new edge cost and applying some 
additional user provided penalty for eliminated precedences is particularly 
effective. We also used transposition tables at levels 3 and 4 to keep track of 
already visited states and to avoid their re-expansion. 



4 Search 

Our search algorithms are all derived from depth-first branch&bound. We 
branch depth-first because memory is reserved to store lower bounds. For the 
partial tour si G 5/, let 

f(si) = c(si) +b(si) (3) 

be an estimate of the total cost of the completed tour which is comprised from 
the cost of the partial tour c(si) and its estimated completion cost b(si). If 
f(si) exceeds the cost of the best known feasible solution (the incumbent) 
then it can be pruned. The branches are also sorted in increasing / value 
order. Plain branch&bound can be greatly improved because of two special 
properties of the SOP. First, the SOP can be solved by searching from both 
directions and second, any consecutive sequence of vertices in any feasible 
tour also corresponds to a smaller SOP by itself. The cost matrix of the sub- 
problem SOP can be obtained by readily taking entries from the original cost 
matrix and this subproblem can be solved independently. In our experiments 
we found that search in one direction is often much faster than in the other 
and therefore it is worthwhile searching from both directions. The switch from 
one direction to the other is triggered by reaching a user set node expansion 
limit. The search in both directions works on refining the same incumbent. We 
named this algorithm bi-directional depth- first branch&bound (or BDFBB). 
Recursive depth-first branch&bound (or RDFBB) uses a user imposed tol- 
erance limit L. When the number of nodes expanded in the search under a 
subtree T exceeds L, the subproblem SOP corresponding to the largest sub- 
tree not including the start state but including T is solved independently with 
its own automatically generated lower bounds. We also employed a 3-opt on 
each new incumbent to opportunistically improve it (also used by [2,6,11]). 
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Table 1. Generating Lower Bounds for p43.4 



5 Results and Discussion 

The two control parameters we supply to calculate the lower bounds are the 
maximum number of abstract states on a single level (maximum width) and 
the error function which the abstractions between consecutive levels optimize. 
As we have mentioned, minimizing absolute error (AE) proved to be effective. 
This is very clear from Table 1 which shows the average value of lower bounds 
(ave(5)), the lower bound corresponding to the start state (bo) and the time it 
took in seconds to build the pattern databases of various sizes. The problem 
is one of the previously unsolved ones called p43.4 from the TSPLIB [12]. bo 
is also a lower bound for the SOP itself. The bounds which are tighter than 
the previously best known value of 69,569 are shown in bold font. We com- 
pare randomly chosen abstractions to the ones that minimize AE. The values 
reported in the columns under “Random” correspond to the best from a pool 
of 20. Our smallest AE pattern database has much higher lower bounds than 
the best of 20 random ones which is also 16,384 larger. This experiment also 
reveals an interesting phenomenon that we encountered on more than one 
occasions. The AE pattern database with width 2000 is better than many of 
the larger ones minimizing the same error measure. At this time we have no 
explanation other than the abstractions seem to preserve the costs between 
the levels particularly well. With RDFBB, in 22 hours of CPU time we de- 
rived that the value of 83,005 is optimal 1 . We also have matched the best 
reported upper bounds within 60 minutes of CPU time to the open problems 
p43.2, p43.3, p43.4, ry48p.2, ry48p.3, ry48p.4, ft53.2 and ft53.3. In 
these experiments we used BDFBB and also utilized a 3-opt edge exchange 
heuristic. We also generated a problem set of 16 SOPs; each over 30 ver- 
tices. These are derived from 4 base problems. Two correspond to rounded 
Euclidean distances on a 500x500 and a 6x6 grid with some random noise 

1 which contradicts a previously reported upper bound of 82,960 whose origin we 
could not trace 
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Table 2. Nodes Expanded and CPU Times of the Problem Set 



added to third of the edge costs. The other two are uniform random costs in 
[0, 1000] and [0, 10]. Next, we generated four random precedence graphs. We 
applied the constraints implied by these to each of our four base problems 
and obtained SOPs with 107 (1), 160 (2), 210 (3) and 253 (4) precedence 
constraints. These include the 57 trivial precedences which are due to the 
fact that the start and terminal vertices are known. For ease of reference, we 
named these 16 test problems suggestively. First, we investigate solving these 
problems with three different size pattern databases of exponentially larger 
sizes. To compare them we measure nodes expanded in the search and CPU 
time. For these experiments we did not use the 3-opt tour improvement, only 
pattern databases. The results are tabulated in Table 2. Our results show 
that having larger databases pays off. In the case of 500x500-1 allocating a 
5 times larger database results in a 148 fold reduction in nodes expanded. 
Increasing this size yet another 5 times and there is another 21-fold reduction 
in nodes expanded. While these very high ratios are not typical, our experi- 
ments indicate that in general the trade-off between memory and search speed 
favors adding more memory. It is also the case that, in most cases, the search 
finishes much faster when the SOP is more constrained. The branch&cut 
technique of Ascheuer et al. [2] solves the less constrained SOPs faster. The 
limiting factors in branch&cut, besides the dimensionality, are the size of 
the pool of inequalities that have to be searched and the construction of 
the facet inducing inequalities. Non of these are eased by more precedences. 
For us, more precedence constraints mean less branching in the search space 
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Table 3. Nodes Expanded and CPU Times of the Problem Set 



and therefore less node expansions. Table 3 compares plain DFBB (Plain) 
to RDFBB (Rec) and RDFBB with transposition tables (Rec + Trans) with 
the smallest (maximum width 50,000) pattern databases. The values in bold 
show improvements that resulted in less search effort than searching with 
plain DFBB with a 5 times larger pattern database. The improvement is of- 
ten remarkable but not always present. It requires further investigation to 
examine the cause as there is a large number of parameters to be set, such 
as the size of subproblems, databases and expansion limits. 

With DFBB, the cost of the initial sequence of feasible solutions is very 
important since the costs are used as pruning bounds. Interestingly, we found 
that the size of the pattern database and even the magnitudes of the lower 
bounds stored have no relevance whatsoever when it comes to obtaining cheap 
solutions fast. Therefore the use of a 3-opt makes a very big difference. In 
fact, to this end we believe it would be more effective to start with the cheap 
and fast solutions of the HAS-SOP system [6] and instead of ordering by / 
values (Equation 3), we could make use of intermediate solutions of the LP 
relaxation of the branch&cut solver [2] . The solution to the LP relaxation is 
a fraction in [0, 1] corresponding to each edge of the SOP. We could interpret 
these values as probabilities that tell how likely it is that the particular edge 
is included in the tour. We would sort branches by these probability values 
but still use our lower bounds for pruning. 

We would also like to mention that our lower bounds could be generated 
when the precedences are arbitrary boolean constraints - such as “vertex 
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2 or 3 must precede vertex 4” and when some precedence violations are 
allowed when some user defined penalty is paid. In fact, we believe that 
pattern databases could be effective to generate lower bounds for a number 
of constrained Scheduling/Operations Research problems. 

I would like to dedicate this work in the memory of my dear friend, Dr. Baldzs 
Zombori, who recently died in a car accident 

This research was supported in part by a research grant provided by the 
Natural Sciences and Engineering Research Council of Canada. I would also 
like to thank Dr. Robert C. Holte (University of Alberta) for his insights and 
encouragement. 
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Abstract. The paper deals with a single processor scheduling problem in which 
the sum of values of all the jobs is maximized. The job value is characterized 
by a stepwise non-increasing function with one or more moments at which a change 
of job value occur. Establishing an order of processing of datagrams which are 
sent by router is a practical example of application of this problem. It is proved 
in the paper, that a special case of the considered problem - with a single common 
moment of job value change and zero value of jobs after this moment - is NP-hard. 
Therefore, a pseudo-polynomial time algorithm for the case with common moments 
of job value change is constructed. It is also constructed and experimentally tested 
a number of heuristic algorithms which solve the general version of the problem. 



1 Introduction 

The paper deals with a scheduling problem, where the sum of job values 
is maximized and a job value is described by a non-increasing stepwise func- 
tion. Such problem was considered in papers [4] and [5] and in this paper 
we show some additional results. Besides, the only problem, from among 
these ones which deal with job values, the problem with an exponential model 
of job value was investigated ([8] and [1]). 

Establishing an order of processing of datagrams which are sent by router 
is an application example of the problem with a stepwise model of job value. 
The precise description of this event is given as follows. One of the tasks 
of router is to determine a path which the datagrams will be sent by far- 
ther. Each datagram includes - among other things - a field called Time 
To Live (TTL), which determines how long the datagram could be in a net- 
work. A value of TTL is set by sender for each datagram. However, this 
value is decreased in each router, proportionately to its processing time 
in the router. But it has to be decreased by at least 1 unit (even if the pro- 
cessing time is shorter than 1 second). If the value of TTL is equal to 0 
and the datagram does not achieve the destination, then such datagram 
is abandoned and the sender receives an error message. The processing of 
datagram by the router may be called as a job. However decreasing of the 
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TTL value during the processing datagram by the router may be described 
by a non-increasing stepwise function. The problem is to find such an order 
of processing the datagrams in the router that the sum of TTL values of 
these datagrams (calculated after this processing) is maximal. Beside that, 
we can meet this problem for example in a process of distributing and sell- 
ing the commodities with a short sell-by date or in an orcharding (when we 
establish an order of picking of some kinds of fruits so that the total profit 
made on selling all fruits is maximal). 

The remaining part of the paper is organized as follows. In the next section 
we give the precise formulation of the problem under consideration and in Sec- 
tion 3 it is proved that its special case - with a single common moment of job 
value change and the zero value of jobs after this moment - is NP-hard. 
Section 4 deals with a pseudo-polynomial time algorithm constructed for 
the problem with common moments of job value change and in Section 5 
we present and experimentally compare some approximate algorithms con- 
structed to solve the general version of the problem. Some concluding remarks 
are given in Section 6. 



2 Problem Formulation 

There are given a single processor and a set J — {1 , . . . , n} of n independent 
and non-preemptive jobs immediately available for processing at time 0. Each 
job i is characterized by its processing time Pi > 0, its value Wi(Ci) calculated 
at the completion time Ci and the moments dij > 0, j = 1 . . . k — 1 at which 
a change of job value occur. The model of job value is given by non-increasing 
stepwise function defined as follows 



m(Ci) 



( u^i, 0 ^ ^ d%\ 

Wfä-, d%\ Ci di2 



Wik, dik—i < Ci 



where wn > Wi 2 > ... > Wik . The objective is to find a schedule 7 r that 
maximizes the sum of job values. 

Using the notation a | ß | 7 for scheduling problems [3], the problem 
considered in this paper is given by 



V 

II 

s 


0 Ci ^ di\ 

dil < Ci < di2 




< Wiki dik— 1 < Ci 



1 
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3 Computational Complexity 



It is shown now that defined below NP-complete Partition problem [2] can 
be transformed in polynomial time to the decision version of the problem 
wn, 0 < Ci < di 



1 



Wi(Ci) 



0, d\ < Ci 



EMCi)- 



Partition: Given a set X = {x±,X 2 , . • . , x m } of m positive integers for which 
22=i x i — 2J3; does there exist a partition of the set X into two disjoint 
subsets X\ and X<i such that ^2 x . eXl x % — Y^ Xi ex 2 Xi ~ ^ 



Theorem 1. The problem 1 
hard. 



m(Ci) 



run, 0 < Ci < d\ 
0, d\ < Ci 



Y2wi(Ci) ™ NP- 



Proof. Given an instance of Partition, construct the instance of our schedul- 
ing problem as follows: 

n = m; Vi — w n — x %\ d — y = B; i = 1, . . . , m. 

It is easy to see that the transformation given above can be done in polyno- 
mial time. Now we show that Partition has a solution if and only if there 
exists a solution to the constructed instance of our scheduling problem with 
the value YS= i w i( c %) > V- 



“Only if’. Assume that Partition has a solution, i.e., J2 Xi ex 1 x i = 
'52 Xi ex 2 Xi = Let Ji and J 2 denote the sets of jobs constructed based 
on the elements from the subsets X\ and X 2 , respectively. The processor 
executes the jobs in the following order: at first the jobs from set J\ in an ar- 
bitrary order and then the jobs from set J 2 in an arbitrary order, as well. 
The sum of job values obtained for such a schedule is equal to 

n 

= E wci) + E 

%— 1 i€zJi 1&J2 



Since pi = Xi, thus 2 zg Ji Vi — B = d. It means that only the jobs from set 
J\ are completed not later than d. Thus we have 

n 

E™*^*) = e w n + 0 = E wn = E Xi - 

i— 1 i£Ji i(zJi zGX 1 



Prom the assumption ^ x . €Xi x i = B follows that 

f wn, 0 < Ci < di 

\0, 



what means that 1 



m(Ci) 



d\ Ci 



E 



Er=i^*( c <) = b = Vi 

Wi(Ci) has a solution. 



“If’. Assume now that Partition has no solution. It means that Ea:*eXi x i 7^ 
B and Y^ Xi ex 2 x i ¥" B for an Y subsets X\ and X 2 . There are two cases 
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to be considered, namely: a) ^2 x . eXl = B — X and J2 Xi ex 2 = B + X 
and b) ^2 X eXl x i = B X and Yl x . eX2 x i = B — X, where A is some 
positive integer. The criterion value obtained for the case a) is equal to 

Ei 6Jl Wil = E Xi SXi X i < B ■ For the case b )> we have Ei€J,\{J t } w il = 

< B, where Jk is the set of jobs from Ji, which complete 
after d and Xk is the set of elements which correspond to jobs from J&. □ 



4 Pseudo-Polynomial Time Algorithm for the Case 
with Common Moments of Job Value Change 



T 

1 



here exists a pseudo-polynomial time algorithm (PPT) for the problem 



Wi(Ci) = 



0 ^ Cj 5^ d\ 
di < Ci < d 2 
Wi 3 , d 2 <Ci< d 3 
^ d 3 <C C% 



5 ~2wi(Ci ), which computational complex- 



ity is equal to 0{n 2 did 2 d 3 ). The maximum sum of job values is the value 
of function Fj(ti,t 2 ,t 3 ) where t\,t 2 ,t 3 are the state variables. The variable 
U , i G {1,2,3}, denotes the sum of processing times of such jobs, for which 
the completion times are larger than di - 1 and not larger then di, where 
do = 0. The variable l ( l = 1,2 ,...,n) denotes the job which is sched- 
uled as the first from among these ones which are completed later than d\ 
and not later than d 2 . 

The formal description of this algorithm is given below 



PPT Algorithm 



Step 1: Renumber the jobs according to LPT rule, i.e., p\ >p 2 >,. . .,>p n * Set 
^ 2=P " >3 = ° mdP '- , ‘ 2 - 

Step 2: For each l = 1, 2, . . . , n; t\ = 0, 1, . . . , d\; t 2 — 0, 1, . . . , min{d 2 — ii, 
d 2 - di + pi}; ts=0, 1, . . . , d 3 - (ti + 1 2 ) calculate ift 2 + t 3 < d 3 - d 2 + pi: 



r -PjMM) + Wju 

ift\> Pj and j ^ l 



F l j{ti,t 2 ,t 3 ) = max < 



F l j_i(ti,t 2 - pj,tz) + w j2 , 

if t 2 > Pj and j ^ l 

Fj-l(tl,t 2 , t 3 - Pj) + Wj 3, 

if t 3 > Pj and t 3 < (d 3 — d 2 ) -f- pj and j ^ l 



l F^^ti^U) +Wj 4 , if j = l 

If j = n, then go to Step 3, otherwise set j := j + 1 and repeat Step 2. 
Step 3: Find the optimal schedule by backtracking. 
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We calculate now the computational complexity of this algorithm. Since 
we have n different values of j and Z, and at most d{ different values of U, i£ 
{1, 2, 3}, then Step 1 and Step 2 require 0(n 2 did2ds) operations. While Step 3 
requires n operations. Thus, the whole PPT Algorithm requires 0(n 2 did2ds) 
time. 

5 Approximate Algorithms for the General Case 
of the Problem 



Since the problem 1 



Wi{Ci) = < 


0 Ci ^ di\ 
d iX <C Ci ^ di2 




k Wiki dik—i < Ci 



X>i(Ci) is NP-hard, 



it is highly unlikely to construct the fast algorithms (i.e. polynomial) which 
give the optimal solutions of the problem. Therefore, in order to solve it, we 
construct and experimentally test some approximate algorithms. We present 
in this section the most interesting results of this research. Thus we describe 
four fast heuristic algorithms which computational complexity is 0(n log n) 
and a modification of one of them which computational complexity is equal to 
0(kn log n), where k denotes a quantity of moments of job value change. Then 
we show the results of numerical experiment which compares the efficiency 
of considered algorithms. 

The algorithms Pi wn \ and Pi/wn /* construct the solutions by se- 
quencing the jobs in non-decreasing order of p *, in non- increasing order of wn 
and in non-decreasing order of Pi/wn , respectively. Two next algorithms 
M m df and kM m df are the modifications of the Moore algorithm ([6], [7]). 
The Mmdf is described bellow: 



Algorithm 1 The M m df algorithm 

Step 1: Set 7T 1 :=0, 7 r 2 :=0 and J:={1, 2, . . . , n}. 

Step 2: Find a job i* that satisfies di*± = min^j^i). Put job i* on the last 
position in i r 1 . Set J := J\{i*} and go to Step 3. 

Step 3: If Ylie w 1 P i — 1 ^en go to Step 4, otherwise find job k * £ n 1 that 

satisfies Pk*/wk * i — max^i (pi/wn) and put it on the last position 
in 7 r 2 . Set 7 r 1 := 7r 1 \{A:*}. 

Step 4: If J = 0 then STOP - the permutation i r 7r 1 7r 2 is the expected 

solution, otherwise go to Step 2. 



The kMmdf algorithm is the following modification of the M m df • 
Algorithm 2 The kM m df algorithm 

Step 1: Set 7 r:=0, 7r':=0, J c :={ 1 , 2, . . . , n}, J d :=® and j := 1 . 

Step 2: Find a job i* that satisfies di*j = min^ jc(d^). Put job i* on the last 
position in 7r'. Set J c J c \{i*} and go to Step 3. 
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Step 3: If X^gtt Pi + X^e Pi — ^*3 ^ en 9° t° e P 4> otherwise find job 
k * G 7 r' that satisfies Pk*/wk* j = maxie 7r / {Pi/ W ij) and add it to the J d . 
Set 7 r' := 7r'\{A:*}. 

Step 4: If J c = 0 then set 7 r := 7T7r', 7r' := 0, J c := J d , J d := 0 and go £o 
S7ep 5, otherwise go to Step 2. 

Step 5: If J c = 0 or j = k then STOP -7 t is the solution , otherwise set 
j := j + 1 and go to Step 2. 

In the numerical experiment, made on a computer with Pentium II 300 MHz, 
176 MB RAM and Windows XP, the parameters values of the problem were 
randomly generated according to the uniform distribution, and the algorithms 
were tested for the following different sets of the parameters values: 

Set 1: Pi € (0, 90), Wn G [1, 10), fcG [1, 10), dij G [dij—i + 100, g^j_i+200); 

Set 2: pi G (0, 90), Wn G [1, 100), k G [1, 10), dij G [dij — i + 100, dij — i +200); 

Set 3: Pi G (0, 10), wn G [1, 100), k G [1, 10), dij G [dij — i +5, dij—i + 15); 

for i = 1, . . . , n and j = 1, . . . , k — 1. Moreover, the values of Wij for j = 

2, . . . , k are randomly generated from the following intervals: G (0, w^- 1 ). 

For each set of the parameters values there were randomly generated 500 
instances of the problem for each n — 9, 50, 100, 250, and 500 jobs. Thus, 
it was generated 7500 instances of the problem in all. For n = 9, for each 
generated instance the optimal solution was found by explicit enumeration 
(let OPT denotes the criterion value for this solution). Then, for each algo- 
rithm we calculated a performance ratio: (OPT/ALG— 1) • 100%, where ALG 
denotes an objective function value obtained by the considered algorithm. 
For n > 9, for each generated instance of the considered problem the al- 
gorithm which gave a solution with the largest criterion value was found. 
Let Abe st denote the largest criterion value. Then, the following perfor- 
mance ratio (Abest/ALG— 1)*100% was calculated for the other algorithms. 
The average values of the performances defined above, obtained for all 500 
generated instances of the problem, with a given n and given set of param- 
eters values, are shown in the Table 1, and an average execution times (ms) 
of the algorithms for Set 1 is given in the Table 2. 

As you can see in the Table 1, the values of the problem parameters have 
an influence on the algorithms accuracy - if wn G [1, 100) or pi < dij-i—dij 
does not hold for each i and j (i = 1, . . . , n, j = 1, . . . , k — 1, dio =0) then 
the accuracy of all considered algorithms is worse. Notice also that the kM m df 
algorithm is the most accurate (e.g., for n > 9, for most cases it gives the best 
solutions) but two others (pi/wn /* and M m df) are also accurate - for n = 9 
for some cases they deliver better solutions than the kM m df . Moreover these 
two algorithms are more efficient than the first one (particularly for the large 
values of &) because of the computational complexity and what follows, be- 
cause of the execution time. The simple heuristics (pi f and Wn \) are 
the least accurate from among the considered algorithms - e.g., they deliver 
solutions about 10 to 40 percent worse than the optimal ones for n = 9. 
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Table 1 . Average performance ratios for the considered algorithms 



n 


Pi / 


wn \ 


Pi/wn / 


Mmdf 


hMpndf 


Set 1: pi G (0,90), wn G [1, 10), k G [1, 10), Adij G [100, 200) 


9 


5.99 


11.13 


5.62 


4.35 


4.07 


50 


23.88 


88.42 


13.76 


14.37 


0.22 


100 


10.19 


84.18 


4.48 


11.66 


0.00 


250 


7.82 


64.19 


5.45 


6.60 


0.28 


500 


23.16 


405.05 


12.22 


23.87 


0.00 


Set 2: pi G (0,90), wn G [1, 100), k G [1, 10), Adij G [100,200) 


9 


8.60 


11.92 


8.00 


5.12 


5.26 


50 


19.73 


81.38 


1.79 


11.37 


0.00 


100 


33.86 


145.04 


14.93 


24.10 


0.00 


250 


22.06 


129.09 


8.28 


18.45 


0.00 


500 


20.11 


199.53 


9.14 


16.90 


0.00 


Set 3: pi G (0, 10), wn G [1, 100), k G [1, 10), Adij G [5, 15) 


9 


17.43 


41.67 


8.23 


16.96 


9.35 


50 


8.59 


93.43 


8.73 


1.23 


0.00 


100 


20.42 


186.31 


14.96 


13.03 


0.00 


250 


20.95 


456.22 


11.19 


13.24 


0.00 


500 


19.65 


573.08 


7.20 


10.51 


0.00 



Table 2. Average execution times (ms) of the considered algorithms (for Set 1) 



n 


Pi / 


wn \ 


Pi/wn /* 


Mmdf 


kM m df 


9 


0.000 


0.000 


0.000 


0.000 


0.000 


50 


0.000 


0.000 


0.000 


0.000 


0.625 


100 


0.000 


1.250 


2.813 


0.630 


1.543 


250 


6.449 


2.832 


7.494 


7.168 


17.702 


500 


10.000 


10.031 


30.000 


22.622 


35.841 



To sum up, we constructed three efficient algorithms which solve the gen- 
eral version of the considered problem. 



6 Conclusions 

In this paper, we considered a problem of scheduling jobs on a single proces- 
sor in order to maximize the sum of job values. The job value is characterized 
by a stepwise non- increasing function with one or more moments at which 
a change of job value occur. It is proved, that a special case of the problem - 
with a single common moment of job value change and the zero value of jobs 
after this moment - is NP-hard. Thus, it is highly unlikely to construct an op- 
timal algorithm solving the considered problem in polynomial time. Hence 
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we constructed a pseudo-polynomial time algorithm for the problem with 
common moments of job value change and also a number of approximate 
algorithms for the general version of the problem. The computational com- 
plexity of the pseudo-polynomial time algorithm is 0(n 2 did2ds) (where d*, 
i G {1,2,3}, denotes the moments of job value change) thus it is especially 
efficient for the problems with small values of di. For the general version 
of the problem we constructed two algorithms with computational complex- 
ity equal to 0(n log n), which derive the solutions about 10 percent worse 
than the optimal ones, and one algorithm which is not polynomial one (with 
computational complexity equal to 0(&-nlogn)) but it gives better solutions 
than the two previous algorithms and it can be efficient for problems with 
small quantity of moments of job value change (the parameter k). 
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Abstract. We explore Small Instance Relaxations in branch- and-cut for the TSP. 
For small TSP instances of up to 10 cities all facet-defining inequalities of the 
associated polytopes are known. To exploit this pool of inequalities, we shrink a 
given TSP support graph to a small graph with at most 10 vertices, search for a 
violated inequality in the pool, and eventually lift it to obtain a cutting-plane. A 
Small Instance Relaxation (SIR) is an LP relaxation strengthened by such cutting- 
planes. We mainly shrink k - way cuts ( k < 10) of weight k\/2 to obtain promising 
small graphs (A is the mincut weight). For the separation in the low-dimensional 
space we solve a series of QAP instances. Padberg-Rinaldi shrinking criteria, graph 
isomorphism detection and facet class selection are applied to avoid unnecessary 
QAP computations. Our computational results show the usefulness of SIRs for the 
TSP. We compare SIRs with local cuts by Applegate et al. 



1 Introduction 

In the TSP we search for a cheapest Hamiltonian cycle or tour in the undirect- 
ed complete graph K n = (V n ,E n ) with V n = {1, . . . , n} and n(n — 1)/2 edges 
E n = {{ 1, 2}, {1, 3}, . . ., {n — 1, n}} weighted by the travel costs c e for e G E n . 
The cost of a tour is the total cost of its edges. Let x = (x e ) ee E n be a variable 
vector. Let W C V n and F C E n . We define <5(W) := {e G E n \ \ W fl e\ = 1} 
and x(F) := ^2 eeF x e . The Dantzig-Fulkerson- Johnson TSP model is: 



min c T x 






x(<5({u})) = 2 


for all v G V n 


(i) 


®($(W)) > 2 


for all W C V n with 3 < \W\ < [n/ 2J 


(2) 


x e € {0, 1} 


for all e G E n 


(3) 



Equations (1) are degree equations and (2) are subtour elimination con- 
straints (SECs). The feasible solutions of (l)-(3) are called incidence vectors 
of tours. The incidence vector of a tour T is denoted by x T - We have = 1 
if e G T and = 0 otherwise. The Symmetric Traveling Salesman Polytope 
STSP(n) for n cities is the convex hull of the x T f° r all tours T in K n . 

The most successful method for solving TSP instances to optimality is 
branch- and-cut, i.e. branch-and-bound with the cutting-plane method in the 
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bounding part to strengthen LP relaxations. We assume familiarity with the 
branch-and-cut idea and the basics of polyhedral theory. We suggest and 
investigate a way to exploit the facets of STSP(fc) ( k < 10) for cutting-plane 
generation. See [6,7] for early experiments in this direction. 

Let x* be a fractional solution of an LP relaxation of (l)-(3). Some vari- 
ables may be fixed to 0 or 1 (branching); the others are relaxed to [0, 1]. The 
relaxation may have been strengthened by cuts. If x* satisfies (1) and all 
SECs, we call (V^E* = {e G E | x* > 0},x*) the TSP support graph of x*. 

Where do cuts come from? There are general-purpose cuts which do not 
exploit the problem structure (e.g. Gomory cuts). Further, there are classes 
of problem-specific cuts (e.g. combs). Considerable effort has been invested 
in the identification and investigation of such classes. Separation algorithms 
for them often lag far behind such polyhedral investigations. 

We set out to tap a previously almost untapped yet known and available 
source [4] of cuts for the TSP. We search for cuts in the class consisting of 
the inequalities obtained by lifting to R n ( n-1 )/ 2 the linear descriptions of the 
small polytopes STSP(fc) for k = 6... 10 (Sect. 2). Therefore, a relaxation 
obtained by adding cuts from this class is called a Small Instance Relaxation 
(SIR). The integrative SIR approach subsumes a wealth of cuts computed 
by existing separation algorithms for a variety of classical inequality classes. 
Further, large proportions of the linear descriptions of STSP(9) and STSP(10) 
do not intersect with classes described in the literature. We use a generic 
separation algorithm as opposed to algorithms tailored to specific inequalities. 

The separation algorithm is: For 6 < k < 10, we shrink k - way cuts in a 
given TSP support graph. The shrinking defines a linear map from R n ( n-1 )/ 2 
to R fc ( fc-1 )/ 2 . If the weight vector of a shrunk graph is inside STSP(fc), we 
fail. Otherwise, we usually get many violated inequalities from the linear 
description of STSP(fc). We lift these to R n ( n-1 )/ 2 using zero-lifting [10] and 
obtain facet-defining inequalities for STSP(n) violated by x*. Many different 
k - way cuts are chosen (Sect. 4). Generic separation in the low-dimensional 
space (Sect. 3) is done by solving small instances of the Quadratic Assignment 
Problem (QAP). This is the bottleneck. We suggest strategies to reduce the 
number of QAP instances to be solved (Sect. 5). 

Applegate et al. [1] suggest an approach which does not care about classes. 
In a support graph they shrink k - way cuts with k at most about 30. They 
try to compute a cut in the small space by applying techniques from linear 
programming and polyhedral theory without running separation algorithms 
for specific inequality classes. The k - way cuts they choose contain most of V n 
in a single subset. They zoom in on small regions. This motivated them to 
call the resulting cuts, embedded in the Concorde code, local cuts [1]. 

Our SIR approach and the local cut approach have similarities. Both 
reduce the problem size by shrinking k - way cuts ( k small) in support graphs. 
However, the choice of A:- way cuts and the separation in the low-dimensional 
space differ. Both approaches have interesting aspects (Sect. 7). 
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2 Low-Dimensional TSP Polytopes 

A minimal linear description of STSP(fc) consists of k degree equations and 
exactly one facet-defining inequality for every facet of STSP(fc). The k inde- 
pendent equations reduce the dimension of STSP(fc) to ( k(k — l)/2) — k. The 
last column in Table 1 lists the number of facets at an extreme point. The 
linear description of STSP(IO) is conjectured to be complete. 



Table 1. Low-dimensional TSP polytopes [2, 5, 7, 8] 



k 


dim 


#tours 


# facets 


#classes 


degeneracy 


6 


9 


60 


100 


4 


27 


7 


14 


360 


3,437 


6 


196 


8 


20 


2,520 


194,187 


24 


2,600 


9 


27 


20,160 


42,104,442 


192 


88,911 


10 


35 


181,440 


>51,043,900,866 


>15,379 


>13,607,980 



All facets of STSP(A:) for 6 < k < 10 are publicly available [4]. For 
3 < k < 5 the inequalities x e > 0 and the SECs defined on two vertices 
together with the degree equations are sufficient. We do SEC separation first. 

The facets in [4] are divided into pairwise disjoint symmetry classes. For 
each class a representative f T y > fo is provided. The represented class is 

{ f*(e)y e > fo I 7T G n k } (4) 

e£Ek 



where Ilk are all permutations of {1, ... , k} and 7r(e) = 7r({i, j}) := {7r(i), n(j)}. 



3 Separation in the Low-Dimensional Space 



Let y* be the weight vector of a &- vertex graph obtained by shrinking a A:- way 
cut (6 < k < 10) in (V n ,E*,x*). To separate y* from STSP(fc) we solve a 
series of QAP instances: one per symmetry class. Brute- force checking of all 
facets is clearly too slow. Given square matrices (a^) and (6^) the QAP is 



min 

7T 






(i)Tr(j)bij 



« 3 



where 7r is a permutation. We have symmetric matrices with a^- = f{ij} and 
bij = for i j. The main diagonals are 0. In essence, we consider 



min 

Tr en k 



f«e)Vt ■ 

e£Ek 



(5) 
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Every 7 r for which the sum in (5) is smaller than /o defines a cut. This 
generic separation method can exploit partial linear descriptions. Since the 
QAP is hard and the number of classes is rising sharply, a small k is desirable. 

For exact separation, we use a branch-and-bound algorithm [3] modified 
so that all n giving a left-hand side smaller than /o in (5) are computed. Our 
QAP instances are sparse. For heuristic separation, we use GRASP-sparse 
[11]. Per iteration, a good permutation is constructed and locally improved. 
We can trade off quality against speed by choosing the number of iterations. 

4 Generation of Small Graphs by Shrinking 

Which k - way cuts should be shrunk and how can they be computed? 

Our shrinking is guided by x*. The representatives f T y > fo (and the in- 
equalities in (4)) are in TT form [10]. In particular, we have f e > 0. Therefore, 
shrunk graphs with low total edge weight y* tend to keep the left-hand 
sides in (4) low on average for all symmetry classes. We go for low Ve- 



4.1 Enumeration of Mincut ^-Partitions 

It is well-known that computing a minimum fc-way cut is polynomial in n 
for fixed k. The best we can get is a partition of V n into k global minimum 
weight cuts. We compute all such mincut fc-partitions of a TSP support graph 
(shrunk 1-paths and every vertex is a mincut). While not every graph has 
such a fc-way cut, TSP support graphs usually have many. The literature on 
minimum A:- way cuts mainly deals with k < 6. We are interested in and our 
enumeration algorithm works well for 6 < k < 10. 

We use the cactus representation of all mincuts of a graph [13]. It is as a 
data structure storing all (that is 0{n 2 )) mincuts of an n- vertex graph with 
positive edge weights. The space requirement is 0{n). The inclusion- and 
intersection-structure of the set of mincuts is captured by the representation. 
See [13] for a very fast cactus construction algorithm for TSP support graphs. 
An explicit list of all mincuts takes 0(n 3 ) space: too much in most cases. 

Our algorithm enumerating the mincut fc-partitions is polynomial in n 
for fixed k and requires 0{n 2 ) space to run. It is an exhaustive enumeration. 
From experience we know that the enumeration times explode if we get the 
enumeration strategy wrong. Having chosen some pairwise disjoint mincuts, 
we try to choose a further mincut not overlapping with the ones already 
chosen. A key to make the enumeration fast in practice is to consider the 
mincuts sorted such that their cardinality is non-increasing. This gives effec- 
tive bounding criteria to keep the enumeration tree small and it allows a fast 
cactus-based test for overlap. We use a list of ‘mincuts’ consisting of point- 
ers into the cactus data structure which holds the actual mincuts. Intuitively, 
choosing large mincuts early ‘blocks’ large parts of V n and subsequent overlap 
tests get more efficient. For the sake of brevity, we cannot go into details. 
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For example, on a 2800 MHz PC the algorithm took 2.1 seconds to enu- 
merate all 2,632 mincut 10-partitions of a pr2392 TSP support graph (shrunk 
1-paths) having 3,442 mincuts. The cactus construction took 0.03 seconds. 

4.2 Randomized Shrinking and Vertex Neighborhoods 

Our fully-fledged SIR code uses further methods to compute small graphs. 

We randomly shrink edges until we have ft- vertex graphs [9] . We choose an 
edge with probability super-proportional (in [9] proportional) to its weight. 
This yields (compared to [9]) lower total edge weights m the sma -U 

graphs. Put differently, we compute many near- minimum ft- way cuts [9] . 

We choose vertex neighborhoods N(v) with |iV(u)| = fc — 1. An N(v) to- 
gether with V n \N(v) forms a ft- way cut. To get shrunk graphs with low total 
edge weight, we grow neighborhoods by adding vertices that see it by the 
most weight (max-back order). We also choose neighborhoods by breadth- 
first-search (BFS). In [1] only a BFS strategy is used to get small graphs. 

5 Reducing the Number of QAP Instances 

We have strategies to circumvent costly but unavailing QAP computations. 

5.1 Padberg- Rinaldi Shrinking Criteria 

A vertex set 5 in a TSP support graph is called shrinkable if there is a TSP 
cut after shrinking S given there was one before. In [12] a sufficient condition 
C for a mincut S to be shrinkable is given. This shrinking is commonly 
applied for |5| < 3 in which case C is automatically satisfied. For \S\ > 3 it is 
usually not applied since it is harder to find suitable candidates S and C has 
to be checked. However, all candidates S can be extracted from the cactus 
representation of all mincuts and the condition C can be checked efficiently 
for \S\ < 7 exploiting STSP(ft) up to ft = 9. We shrink shrinkable sets (also 
1-squares [12]) to reduce redundancy in TSP support graphs. 

P-R shrinking can also help to avoid QAP computations. We only generate 
small TSP support graphs (Sect. 4.1) of order ft + 1 if we have processed all 
small ft- vertex graphs. We are satisfied with some cuts per small G . Assume 
there is a shrinkable set S in G. If there are cuts for G, then also for G/S. We 
have already processed G/S. We can therefore skip G without separation. 

5.2 Graph Isomorphism Detection 

We maintain a pool of all small graphs for which we could not find a small 
cut. A weighted small graph which is isomorphic to a graph in this pool can 
be ignored. This occurs frequently. It saves numerous unsuccessful QAP com- 
putations. Our isomorphism test is fast. We enumerate bijections mapping 
vertices to equivalent vertices. The equivalence relation is crucial. For us, two 
vertices are equivalent if they have the same set of incident edge weights. 
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5.3 Facet Class Selection 

For fc < 9 we check all facet classes (except for SECs and x e > 0) of STSP(fc). 
This is too slow for k = 10. An extreme point x T i n a facet is a root of the 
facet. Facets in the same symmetry class have the same number of roots. We 
learned from experiments that a) facets with few roots are rarely violated 
and b) cuts obtained by lifting such facets get quickly non-binding in the LP. 
We require at least 100 roots yielding exactly 500 classes (Fig. 1). Simple [10] 
classes cannot be obtained from smaller TSP polytopes by zero-lifting. 




Fig. 1. Data on facet classes of STSP(10) and their number of roots 



6 Computational SIR Results 

We calculated on a 2800 MHz Pentium 4 processor. The test bed is chosen 
to allow comparison with [7] where a parallel machine was used. For Table 2 
we only produced small graphs as described in Sect. 4.1 and used GRASP- 
sparse (20 iterations) for the QAP. As [7], we start SIR separation if standard 
separation (exact SEC, heuristic comb and clique-tree [12]) fails. Standard 
cuts alone (NT_ ) on average result in 70% larger B&C trees than using SIR 
cuts on top (NT+). The number of generated different SIR cuts (at most 200 
per LP) is listed. In [7] only 5,124 SIR cuts (some duplicates) were generated. 




377 



The new SIR approach clearly finds far more cuts. Small facet separation was 
successful for about 20% of the small graphs actually tested for cuts. P-R 
criteria (Sect. 5.1) allowed us to skip many (#P-R) small graphs without 
separation. The isomorphism criterion sorted out #Iso further graphs. 



Table 2. Computational results for SIR cuts on top of standard cuts 



Instance 


NT_ 


NT+ 


Cuts 


Tested 


Success 


#P-R 


#Iso 


prl52 


6 


2 


1,057 


188 


71 


1,230 


50 


sil75 


24 


18 


3,401 


545 


220 


29,504 


275 


rat 195 


28 


8 


3,327 


535 


122 


4,053 


70 


dl98 


10 


8 


1,423 


711 


215 


10,728 


1,302 


gr229 


30 


26 


2,691 


1,463 


194 


16,454 


405 


gil262 


14 


16 


1,149 


522 


122 


10,346 


470 


pr299 


68 


32 


1,740 


1,087 


197 


27,115 


225 


lin318 


6 


2 


849 


484 


93 


41,100 


118 


pr439 


74 


82 


7,557 


3,446 


663 


481,231 


2,223 


d493 


24 


24 


6,820 


1,958 


536 


89,161 


816 


att532 


102 


26 


4,995 


3,607 


540 


237,779 


1,966 


ali535 


8 


6 


1,912 


677 


187 


29,696 


367 


si535 


12 


0 


778 


457 


186 


10,909 


247 


gr666 


62 


32 


4,019 


3,423 


376 


41,908 


1,991 


rat783 


16 


2 


1,019 


411 


101 


6,139 


85 


sil032 


2 


2 


7 


48 


1 


112 


60 


Sum 


486 


286 


42,744 


19,562 


3,824 


1,037,465 


10,670 



7 The SIR Approach Versus Local Cuts 

We compare the SIR approach outlined here with the local cut approach 
(LOC) detailed in [1]. Classical inequality classes are a firm basis for both. 

A difference is that SIR follows the paradigm of searching for a cut in a 
predefined class of inequalities while LOC does not. In theory, LOC computes, 
by general-purpose techniques, a single cut facet-defining for the graphical 
TSP (GTSP) polytope if one exists for a given small graph. In practice, LOC 
may fail even if a cut exists and the computed cut is not necessarily facet- 
defining for the GTSP polytope. LOC deliberately goes for a single cut and is 
very fast. SIR, currently restricted to k < 10, usually computes several facet- 
defining cuts for STSP (k) if y* STSP(fc) but may also fail if the involved 
QAP instances are solved heuristically or facet classes are selected. SIR offers 
the chance to select ‘good’ cuts from the computed cuts for a small graph. 

The partitions chosen by LOC usually contain the vast majority of vertices 
in a single element. Therefore, a local cut tends to affect an LP solution 
locally. Our mincut fc-partitions often have several elements of large size so 
that resulting cuts can affect an LP solution more globally. 
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8 Summary and Conclusion 

We have described a way to exploit the facets of small TSP polytopes for 
cutting-plane generation. The approach outlined here has nothing in common 
with the pioneering work [6,7] apart from the idea to use the small poly- 
topes to find cuts. The new SIR approach for the TSP finds more cuts. We 
have suggested strategies to reduce QAP computations - the bottleneck. Our 
method to enumerate all A:- way cuts where each subset is a mincut is interes- 
ting beyond the TSP. For the TSP, it seems promising to combine this method 
to generate small graphs with the local cut ideas by Applegate et al. [1]. 
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Abstract. We consider a multiobjective optimization problem in which objective 
functions are in the form of mathematical expectation of functions depending on a 
random element and a constraints set can depend on the probability measure. Evi- 
dently then probability measure can be considered as a parameter of the problem. 
The aim of this note is to present a survey of some assertions on a stability and 
statistical estimates of the set of (properly) efficient points. To this end, already 
known results from one-objective stochastic programming theory are employed. 



1 Introduction 

It happens rather often that it is reasonable to evaluate an economic activ- 
ity simultaneously by several “utility” functions. If, moreover, there exist a 
random element and a “parameter” (not determined completely but whose 
value must only fulfil some conditions), then a multiobjective optimization 
problem with a random factor usually corresponds (from the mathematical 
point of view) to such situation. A rather general multiobjective optimization 
problem with a random element can be introduced in the following form: 

Find 

min gi(pc, £), z = 1, 2, — , Zi (1) 

subject to x G X such that gi(x, £) < 0, i = l\ 4- 1, . . . , /. (2) 

gi,i — 1, ..., I are functions defined on R n x R s ; £ := £(u;) is an s- 
dimensional random vector defined on a probability space (ß, <S, P); X C R n 
is a nonempty set. (i? n , n > 1 denotes n-dimensional Euclidean space.) 

If the solution x can depend on the random element £ realization, then 

(1) , (2) is a problem of the deterministic (maybe parametric) multiobjective 
optimization. If x has to be determined without knowing the random element 
realization, then at first some new decision rule must be selected, i.e. a deter-, 
ministic optimization problem must be assigned to the original problem (1), 

(2) . This deterministic problem can generally depend on the random element 
through the “underlying” probability measure and can be one-objective as 
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well as multiobjective. A different approaches can be employed to assign a 
new “deterministic” problem. In this note we follow the philosophy of [10] 
(see also [1], [19]). To this end we assume. 

A.l. It is “reasonable ” to prefer a few of the objective functions, say 
% — 1, . . . , I 2 , 1 < h < h, 

A.2. there exist constants fc/ 2 +i, . . . , ki x such that the fulfilling of the relations 

9i{x, 0 < ki, i = I 2 4- 1, . . . , Zi, x G X is “very” acceptable. (3) 

Evidently, under these (very often “acceptable”) assumptions applying 
the stochastic programming approach we can assign to the problem (1), (2) 
a “deterministic” problem in the following (general) form: 

Find 

min gi(x , £), i — 1, . . . , i 2 subject to x G fc F i , (4) 

where &, i — 1, . . . , I 2 (defined on R n x R s ) can correspond to penalty or 
recourse approach in one-objective stochastic programming problems. The 
set K, f <- can be equal to X or it can correspond to probability constraints. 
Evidently in the second case K, F z is determined by the systems (2), (3) and 
depends on the distribution function F ^ of £. However, everywhere JC F s c X 
(for more details see e.g. [10] or [14]). 

The problem introduced by (4) depends on the distribution function F%. 
Consequently, F ^ (or equivalently the corresponding probability measure 
P F z ) can be considered as a parameter of the problem. The aim of this note 
is, first, to deal with the stability with respect to the distribution function 
parameter. (Of course, to investigate the stability of the problem (4) it means 
to investigate the stability of the efficient points set.) Furthermore, we intend 
to deal with the case when an empirical measure substitutes the P F z . 

To obtain new results for multiobjective stochastic problems we employ 
the results achieved for one-objective problems. Namely, a great attention has 
been paid to the stability and empirical estimates in one-objective stochastic 
programming literature (see e.g. [3], [7], [8], [17], [20]). 

2 Some Definitions and Auxiliary Assertions 

A multiobjective deterministic optimization problem can be introduced as 
the problem: 

Find 

min /*(#), % = 1, . . . , r subject to x e 1C. (5) 

fi, i = 1, . . . , r are functions defined on R n , /C C R n is a nonempty set. 

Definition 1. The vector x* is an efficient solution of the problem (5) if and 
only if there exists no x e 1C such that fi(x) < fi(x*) for i = 1, . . . , r and 
such that for at least one io one has f% Q {x) < fi 0 {x*). 
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Definition 2. The vector x* is a properly efficient solution of the multiob- 
jective optimization problem (5) if and only if it is efficient and if there exists 
a scalar M > 0 such that for each i and each x e 1C satisfying fi(x) < fi(x*) 
there exists at least one j such that fj(x*) < fj(x) and 



fi(x*) - fi(x) 
fj(x) - fj(x*) 



< M. 



( 6 ) 



Proposition 1 . [5] Let 1C be a convex set and let fi, i = 1 , . . . , r be convex 
functions on 1C. Then x° is a properly efficient solution of the problem (5) if 
and only if x° is optimal in 

r r 

minV^ Xiffix) for some Ai, . . . , A r > 0; A* = 1. 

xEK, z — ' z — ' 

i = 1 i= 1 

Definition 3. Let h be a function defined on a convex set 1C C R n . h is a 
strongly convex function with a parameter p > 0 if 

h{Xx l -f (1 — A)x 2 ) < A hix 1 ) + (1 — A )h(x 2 ) — A(1 — A )p\\x 1 — x 2 \\ 2 

for every x 1 , x 2 G /C, A G (0, 1). 

Lemma 1. [7] Let 1C be a nonempty , compact , convex set. Let, moreover, h 

be a strongly convex with a parameter p > 0 continuous function defined on 

1C. If x° is defined by the relation x° = arg min h(x), then 

x£K. 

||x — x°|| 2 < -| h{x) — h(x °) | for every x G 1C. 

• || denotes the Euclidean norm in R n .) 



If F and G are two arbitrary 5-dimensional distribution functions, then 
the Kolmogorov metric d^(Pp, Pq) is defined by 



d K {P F , P G ) := d K (F, G ) = sup \F(z) - G(z)\. (7) 

zeR s 



To define the Wasserstein metric dw 1 (PFi Pg) •= dw^F, G) let V{R S ) de- 
note the set of (all) Borel probability measures on R s , Pp, Pq G V(R s ) and 
let p 

M!(R s ) = {v e V{R S ) : / | \z\\v{dz) < oo}. 

R s 

If V(v, p) denotes the set of those measures in V(R S x R s ) whose marginal 
measures are v and p, then 



dwi {v, p) 



‘„ f{ / 



R s xR s 



z — z\\K,(dz x dz) : n G P(z^, p)}, 



is,peMi(R s ). 



(For more details about the Wasserstein metric see e.g. [15].) 



( 8 ) 
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3 Main Results 

To study the stability of the problem (4) we define the sets Q F a , X F t- and 
Q f z. To this end we denote the elements of R t 2 by y = (y\, . . . , yi 2 ). 

Gf* = {V ^ Rh : Vj = EFtdjfa £), j = 1, . . . , h for somex G lC F e}, 

X F z — {x G X : x is a properly efficient point of the problem (4)}, 

(9) 

Gf* = {y £ Rh : yj = EF*9j( x > 0 » 3 = • • • » ^2 for some x G <*>*}. 

If we replace in (4) F ^ by another s-dimensional distribution function 
G, then we obtain JCq instead of /Cp* in (4) and Gg , and instead of 
G f z, X f z, G f z in (9). The aim of this section is, first, to investigate 

A[G F (l,Gg\, A[X f s,X g \, A [Gf*iGg], 

where A[-, •] denotes the Hausdorff distance in the space of nonempty, closed 
subsets of R n (for the definition of the Hausdorff distance see e.g. [18]). To this 
end we employ the Kolmogorov and the Wasserstein metrics. The bounded 
Lipschitz metric ß has been employed to investigate stability of multiobjective 
stochastic linear problems [2]; the results of [16] was employed there. If we 
replace F ^ by its empirical estimate F^, then we obtain empirical estimates 
of G f z, X F t and G F t- We intend to investigate these estimates by a large 
deviation technique [6]. 



3.1 Stability Results 

To introduce the stability results let us, first, denote the support of the 
probability measure P F z by Z F t and let for 8 > 0, Z F t(S) denote the 5- 
neighborhood of the set Z F t . We introduce the following assumptions. 

B.l a. fa, i = 1, . . . , I 2 are uniformly continuous functions on X x R s , 

b. for every x G X, fa, i = 1, . . . , I 2 are Lipschitz functions of z G R s 
with the Lipschitz constants not depending on x G X. 

B.2 a. fa, i = 1, . . . , I 2 are Lipschitz functions on X(3 8) x Z F (y/sS ), (with 
the Lipschitz constants Li), 

b. X is a convex set and simultaneously fa, i = 1, . . . , fa are strongly 
convex (with a parameter p > 0) functions on X(3 8), 

c. JC F z is a nonempty, convex, compact set. 

B.3 a. P F z is absolutely continuous w.r.t. the Lebesgue measure on R s . (We 
denote by h£ the probability density corresponding to P F z), 

s , f 

b. Z F z = I] ( c ji c j)> c j > 0? c j < j — 1? 2, . . . , s and, moreover, 

3 = 1 

there exists a constant $ > 0 such that h£ (z) > for every z G Z F t . 
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Theorem 1. Let 5 > 0, K F t be a nonempty compact set , P F a E V(R S ). If 

1. the assumptions B.2a, B.3 are fulfilled, 

2. G E V(R S ) is an arbitrary s -dimensional distribution function such that 

Zq C Z f s(S ) for S = < min[min(c J - - cj), 5]. 

then there exists a constant Cg > 0 such that 

A[K F z, Kg] < k[dic(PFti Pg)]* < 8, Xg C X a nonempty , compact set 

k > 0 => A[G F t, Qg] < Cq f( . Kk:(Pf^ Pg )] 7 • 

If moreover, the assumptions B.2b, B.2c are fulfilled, then there exist 
constants C x ^ , Cg ^ , Kg ^ > 0 such that the following implications hold 

A[K F a, Kg] < kd F {P F ^, Pg) < 8, k > 0, Xg C X a nonempty , 

convex , compact set =$> A[X F z, Xg] 2 < C x [dK(P F t, Pg)]*, 

A[K F t, Kg] < kd F (P F P g) < 8, Xg C X a nonempty , convex , compact 

k> 0 => Ä[g F( , g Fi ] < C'g^ \J [d K (P F i , Pg)\ « (Kg F + y/[d K (P F , p G )]i). 

The sketch of the proof of Theorem 1 will be given in the Appendix. 

To the validity of Theorem 1 the inequality A[K F t, Kg] < kd F (P F € , Pg) 
for some k > 0 must be verified. To this end we can recall the results of 
[9] . There the case when K F z corresponds to the probability constraints and 
l — l 2 = s, gi+i 2 (x, z) = fi(x) — Zi for some functions fi defined on R n , i = 

1, . . . , s, z = (z\, . . . , z s ) is investigated. If K F a = X C X independently 
on F^, then the inequality A[K F s, Kg] < kdk(P F a , Pg) is fulfilled every time. 
However, in this special case the Wasserstein metric can be also employed. 

Theorem 2. Let P F z E M\{R S ), the system of the assumptions B.l be ful- 
filled . Let, moreover, X C R n be a nonempty, compact set. If 

1. K f $. = X independently on F^, 

2. G is an arbitrary s -dimensional distribution function; Pg E M\{R s ), 
then there exists a constant Cg ^ > 0 such that 

A[Gf*, Qg] < Cg F ^d Wl (P F ^ Pg )• 

If, moreover, 

a. the assumptions B.2b, B.2c are fulfilled, then there exists a constant 
C y _ > 0 such that 



A[XFt, X G ] 2 < C' XFi d Wl (P F( , P G ), 
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b. the system of the assumptions B.2 is fulfilled, then there exist constants 
CU , Kx > 0 such that 

A[Gf€i Gg\ < Cg Fii \fd Wl {PFti Pg)(Kq^ + \J d Wl (Pfz , Pg))- 
The sketch of the proof of Theorem 2 will be given in the Appendix. 



3.2 Empirical Estimates 

To deal with empirical estimates, let {^ k }^ =1 , N = 1, 2, ... be a sequence 
of independent s-dimensional random vectors with a common distribution 
function F^. We denote by the symbol F^- the empirical distribution function 
determined by 

Theorem 3. Let X , JC F t be a nonempty, compact sets, t > 0. If 
1 . = 

a. are uniformly continuous, bounded functions on X x Z F t , 

b. for every z G Z F z, Lipschitz functions on X with the Lipschitz con- 
stants not depending on z e Z F t, 

2. there exist constants K 1 K x (X, t) > 0, k 1 > 0 such that 

P{A[K F t, JC F tJ >t}< K\X, t) exp{— A^TVt 2 }, N = 1,2, .. . 
then there exist constants Kg ^ := Kg ^ (X, t) > 0, kg > 0 such that 
JC f z n C X, P{A[g F t ,G F S N ]>t}< Kl Fi (X, t) exp Nt 2 }. 

If, moreover, 

3. X, /C F z are convex sets, 

4 • gu i = 1, 2, . . . , I 2 are strongly convex (with a parameter p > 0) functions 
on X, 

then there exist constants K\^ := K#^ (X, t) > 0, > 0 such that 

P{[A[X F t, X F e}} 2 >t}< K ^ (X, t ) exp{-fc^ Nt 2 }, N = 1 , 2 ,.... 
The sketch of the proof of Theorem 3 will be given in the Appendix. 

Appendix 

Sketch of the proof of Theorem 1. First, employing the proof technique of [9] 
we can get that there exists a constant K > 0 such that 

£) ~ ^-G 9 i(x, £)| < [Kd K (P F (, Pc?)]*, i = x € X. 
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Furthermore employing the triangular inequality and the properties of the 
Hausdorff distance we obtain the first assertion of Theorem 1. 

To obtain the others assertions we define for A* G (0, 1), i = 1, . . . , Z 2 , 
h _ 

Z) A* = 1, the function g^, A = (Ai, . . . , A* 2 ) by 
*= 1 

h 

9\{x , z) = A z ), xeR n , ze R s . 

i= 1 

It is easy to see that (under the assumptions) g\ is a Lipschitz, strongly 
convex (with a parameter not depending on Ä ) function on X(3S) x Zp{y/sS) 

1 

with the Lipschitz constant not greater then L % (independently on A = 

(Ai Ai a )). 

Employing furthermore the triangular inequality we can obtain 
I inf E F th( x > £) ~ inf E g 9\( x > 01 < I inf E F «^(x, £) - inf Eg9x(x, £)| + 

I inf E g 9 \( x , £) - inf E g 9 x ( x , 01- 
K'fZ K'G 

(10) 

The proven assertions follows now already from the last inequality, the 
assertion of Proposition 1, the stability assertions for one-objective problems 
[9] , Lemma 1 and the properties of the Hausdorff distance. 

Sketch of the proof of Theorem 2 . The proof of Theorem 2 is similar to the 
proof of Theorem 1. However instead of the inequalities for the Kolmogorov 
metric [9] the results for Wasserstein metric [12] must be employed. 

The complete proofs of Theorem 1 and Theorem 2 are given in [13]. 

Sketch of the proof of Theorem 3. To prove the first assertion of Theorem 3 
we employ the approach of [7] or [8] to get for every t > 0 the existence of 
constants k\ > 0, K{{X, t) > 0 such that 

P{|E Ft9i( x , £) “ Ep* 9i( x i £)| > t for at least one x G X 

and at least one i G {1, . . . , I 2 }} < Ki(X, t) exp{— k^Nt 2 }, N = 1,2,... 

To prove the second assertion, we employ again the assertion of Proposition 
1 and Lemma 1, the triangular inequality, the properties of the Hausdorff 
distance and the results of [7] or [8]. 

The complete proof of Theorem 3 (for the case when JC F z correspond to the 
individual probability constraints) is given in [11]. 

Acknowledgement. This research was supported by the Grant Agency of the 
Czech Republic under Grants 402/02/1015 and 402/01/0539. 
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Abstract. We consider a multi-stock market model where prices satisfy a stochas- 
tic differential equation (SDE) with instantaneous rates of return modeled as an 
unobserved continuous time, finite state Markov chain. The investor wishes to max- 
imize the expected utility of terminal wealth but only the prices are available to 
him for his investment decisions. Thus we have a hidden Markov model (HMM) 
for the stock returns. Extending the results in [9] to stochastic volatility we obtain 
explicit optimal trading strategies in terms of the unnormalized filter of the drift 
process. We propose a simple volatility model in which the volatility is a function 
of the filter for the drift process. When applied to historical prices, the optimal 
strategies clearly outperform the strategies based on constant volatility. 



1 Outline 

In Sect. 2 we extend the HMM of [9] by introducing a complete model with 
stochastic volatility. While the HMM with constant volatility already im- 
proves the Merton strategy, considering the stochastic volatility model pro- 
posed in Example 1 leads to even better optimization results, for simulated 
as well as for market data (Sect. 5). Our main contributions are the exten- 
sion of Theorem 2 to stochastic volatility and the implementation of a new 
filter-dependent practical volatility model. An algorithm for the parameter 
estimation is presented in Sect. 4. To keep our notation simple we assume 
interest rates equal 0. For stochastic interest rates, motivation of the model, 
Malliavin calculus, further aspects of parameter estimation, and for more 
references see [9]. 

Notational remarks: T will denote transposition, Diag(u) the diagonal ma- 
trix with diagonal v, T x — (T x ) t ^\ o,t] the augmented cr-algebra generated 
by an ^-adapted process X. 



* Supported by NSERC under research grant 88051 and NCE grant 30354 and by 
the Austrian Academy of Sciences. 
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2 An HMM for the Stock Returns 



Let (ß, A, P) be a complete probability space, T > 0 the terminal trading 
time, and T = (Pt)te[o,T] a filtration in A satisfying the usual conditions. We 
consider one money market with interest rates equal 0 and n stocks whose 
prices S = (S t )te[o,T], S t = (S'* 1 , . . . , S™) T evolve according to 

dS t = Dia g(S t )(p t dt 4- a t dW t ) , S 0 G M n , 

where W = (W t )te[o,T] is an n-dimensional Brownian motion w.r.t. T and 
the (nxn) -volatility-matrices (a t ) t e[o,T] are uniformly bounded, progressively 
measurable w.r.t. T and non-singular with uniformly bounded 
The return process R = (R t ) t e[o,T] is defined by dR t = (Diag(St)) -1 dS t = 
Pt dt + a t dW t . We assume that p = ( pt)te[o,T ]? the drift process of the return, 
is given by pt = BY t , t G [0,T], where Y = (^) t€ [o,T] is a stationary, irre- 
ducible, continuous time Markov chain independent of W with state space 
{ei, . . . , ed }, the standard unit vectors in ]R d , and the columns of the state 
matrix B G ]R nxd contain the d possible states of pt- Further Y is character- 
ized by its rate matrix Q G ]R dxd , where A& = —Qkk = Ylt=i ,i^k Qki is the 
rate of leaving and Qki/^k is the probability that the chain jumps to e/ 
when leaving e/~. 

Since the market price of risk , dt = a^ l BY t , t G [0, T], is uniformly 
bounded the density process (Z t )te[o,T], dZ t = —Z t dl dW t , Zo = 1, is a 
martingale. By dP = ZrdP we define the risk-neutral probability measure 
P which we need for the optimization and which is also the reference mea- 
sure used in filtering. E will denote expectation with respect to P. Girsanov’s 
Theorem guarantees that dW t = dW t + d t dt defines a P-Brownian motion. 
By the definition of P, 

t pt 

a s dW s = / a s dW s , [0,T], (1) 

Jo 

Now we can specify a Markovian model for the dynamics of a: Let the m- 
dimensional process £ = (£t)t€[o,T] be given by 




<& = K6)* + r(&)dWi, 



( 2 ) 



where i/, r are lR m - and ^ mxn -valued and continuously differentiable with 
bounded partial derivatives. Furthermore let a t = t G [0,T], where a 

is continuously differentiable with bounded partial derivatives. 

The conditions imply the usual Lipschitz and growth conditions, hence 
guarantee the existence of a strong solution. 



3 Optimal Trading Strategies 

We consider the case of partial information meaning that an investor can 
only observe the prices. Neither the drift process nor the Brownian motion 
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are observable. Therefore only the events of T s can be observed and all 
investment decisions have to be adapted to T s . Note that T s — T R = T w . 

A trading strategy n = (TTt)te[o,T] is an n-dimensional ^-adapted, mea- 
surable process which satisfies \\crJ7rt \\ 2 dt < 00 , / Q T |//]"7r*| dt < 00 . For 
initial capital xo > 0 the corresponding wealth process X * = (Xt)te[o,T] is 
defined by dXf = 7rJ (fi t dt -f a t dW t ), Xo = xo. is the wealth invested in 
the stock at time £, X t — 1^7Tt is invested in the money market. A trading 
strategy n is called admissible if P(Xf > K * for all t E [0, T]) = 1 for some 
constant K * > — 00 . By Ito’s rule 



/ 



X* = x 0 + / 7T ] S (J S dW s , te[ 0, T] 



(3) 



A utility function U : [x w ,oo) — > M U {— 00 }, x u € 1R is strictly increasing, 
strictly concave, twice continuously differentiable on (x u , 00 ), and its deriva- 
tive U' satisfies Hindoo U'(x) = 0 and lim^-^^^.}- U'(x) = 00 . We denote the 
inverse function of U f by I : (0, 00 ) — > (x u , 00 ). We may extend U to x < x u 
as U(x) = — 00 . The optimization problem is: 



Vu = sup { E[U(Xrf)] I tt admissible }, 

i.e. find an admissible trading strategy 7r which satisfies E [U(X^)\ = Vb- We 
call 7T the optimal trading strategy , and denote X = X 71- , so Xt is the optimal 
terminal wealth. 

To determine the optimal trading strategy we have to find a good esti- 
mator for the drift process. By (1) we are in the classical situation of HMM 
filtering with signal Y and observation R , see [1], where we want to determine 
the filter E[Y t | P R ] for it is an L 2 -optimal estimator. 

Theorem 1. The filter rj t = E[Y t | Pf] (f or Y ) th e unnormalized filter £ t = 
E [Z^Yt I Pf] (for Y ), and the conditional density = E[Z t | Pf] (filter for 
Zt), C 1 = l/Ct; satisfy r? t = ( t £ t , C t _1 = and, 

St = E[r 0 ] + f Q T £s ds + r Diag (£ s )B T (a s a T s J“ 1 dR s , t € [0, T] . 

Jo Jo 



Proof The first equation is Bayes’ Law. It and l^Yt = 1 imply the second. 
The SDE for 8 follows from an extension of Theorem 4 in [1] to stochastic 
volatility (a direct proof can be given). 



The optimal strategy in our main result, Theorem 2, will be expressed in 
terms of the unnormalized filter 8 and its Malliavin derivatives. All quantities 
in the representation below are observable and the filters and derivatives can 
be approximated very well because of the linear structure of the equations. 
For the special use of Malliavin calculus (w.r.t. W) we refer to [9, Sect. 8] 
and the references therein. 
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Theorem 2. If E[I(x fr)] < oo for all x E (0, oo) and if I'(y fr) E L q (P) 
for some q > 1, then Xt = I(yfr) and for t E [0,T], 7r t equals 



V l {B£ t E[^{yfr)\^]^a t E 



4 >{Kt) J 



D t {A^ s )£ s )dW s 



T s 



where y ) = —y 2 I'(y), y is uniquely determined by E[/(y fr)] = xq, A(x) = 
( a ( x ))~ 1 B, D t (A(£ s )£ s ) = ( D t £ a )A(£s) T + (D t t; s )(d x A(t; s )£ s )) T , and d x de- 
notes the Jacobi matrix w.r.t. the components of£. Writing aj = (Aj.) T 

/ U 

(D t £ s )Qds 

+ fl f U ((A^)Diag(a,(6)) + (A6) Diag(£,)(0 x a,(&)) T ) dW*, 

3=1 Jt 

DtZu = (t(6)) T + jT(A6)(ö*K6)) T ds + J2 £ (DtMd x T. j (t.)) T dW s . 



Proof A straightforward extension of Theorem 2.5 in [7] yields the existence 
of 7T and Xt — I(yfr) • By comparing (3) and Clark’s formula, see [6], 

alh = E[D t (X T )\F t s ]. (4) 

While the representation for D t ^ s follows directly from [9, Prop. 8.2], the 
equation for £ is more difficult to derive than for constant a since the required 
boundedness conditions don’t have to hold. But considering £^ = h{£^) for 
a bounded function h with suitably bounded partial derivatives, applying [9, 
Prop. 8.2] to these and using convergence results lead to the stated repre- 
sentation, cf. [3]. The chain rules [9, Props. 8.3, 8.4] yield the equation for 
-D*(A(£ S )£ S ) and that Xt lies in the domain with Malliavin derivative 

DtX T = 0J'(Kr)ACr = -$/'(» CrXCr^ACf 1 • (5) 



The result follows using (4), (5), the definition of Qld = 0, and 

ACf 1 = Wt)U = °t X B£ t + £ D t (<j; l B£ s )dW s . 

Important utility functions are the logarithmic utility Uo(x) = log(x), 
x > 0, 17(0) - — oo, and the power utility U a (x) = x a /a , x > 0, for a < 1, 
a =£ 0, because these cover the whole range of risk behaviour. Here 1 — a is 
the Arrow-Pratt index of risk aversion. Analogous to [9, Prop. 4.10], 

Corollary 1. Let a <1, U = U a . Then 



«.= ( b%e k,y 



+ cr t E 



Ct 1 £ D t [aj'B£ t>t ) 



dW s 



&,£t 

tu St 



*e[o,r], 
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where ^ = CVC 1 , = S./tf 1 , X t = xoEfc/ 1 l&.^/Efcr 1 ]. 

In Corollary 1, (£*,£*) is a sufficient statistic for the calculation of 7r t , 
and the Markovian nature of this statistic is very helpful for Monte Carlo 
simulations which we need to compute the second term of 7 r*. Note that no 
third term appears like it does for stochastic interest rates. 

The volatility model in Sect. 2 guarantees a complete market and allows 
for level dependency at = cr(S t ) as well as for dependencies on other F s - 
adapted state- variables like f*Slds, rj t , Rt . Using at as one component of 
£*, we can also implement dynamical models with respect to W. Since these 
often lead to unbounded processes we may have to consider a t = h(£ t ) for 
a bounded function h with suitably bounded and smooth derivatives. For 
empirical findings, surveys and connections to GARCH models see [2], [4]. 

Volatility models with dynamics w.r.t. a second Brownian motion which 
is not perfectly correlated to W (incomplete market) could be implemented 
using the methods in [8], but only under their strong assumptions. 

But our model already covers a lot of empirical findings, like level depen- 
dency, imperfectly correlated stock-volatility, volatility clustering, fat tails, 
etc.. And since volatility results from the action of the traders it is reasonable 
that it depends on observable quantities. If we think of Y t as an indicator of 
the current state of the economy, a model a t = a(rj t ) that depends on the 
best estimate rj t for Y t seems to be appropriate, e.g.: 

Example 1. In the case n = l,d = 2 (one stock, two states) we consider 

a t — cr(rjl), where a(x) = so + S\x + S 2 X 2 

with sp, —si, S2, sq — sf/(4 52) > 0. Since r\\ E (0,1) we can extend a out- 
side <t(( 0, 1)) such that the conditions in Sect. 2 are satisfied. The Malliavin 
derivative of £ = 77 1 needed in Theorem 2 is D t r\\ = — ( u VuD t (~ 1 + ( • 

4 Parameter Estimation and Approximation 

For known covariance matrices the parameters of the drift process, Q and 
B, can be estimated using the EM-algorithm, cf. [1]. This can be done by 
considering the occupation time O \ — J^Y^ds in state e&, the number of 
jumps N kl = J*Y k _dYs from e& to e/, k ^ /, and the level integral G k = 
f 0 Y k dR s . Thinking of O k ,G k , N kl as observations under P parameterized by 
Q and jB, we want to know under which measure P', given by new parameters 
Q' and P', our observation would have been the most probable. After an 
observation interval [0,t], maximizing the likelihood function E[log(Lt) I Ff], 
where dP r = L t dP on T t , leads to 

Q'ki = S t {N kl )/£ t {O k ) and B[ k = £ t (G k )/£ t (O k ) 



( 6 ) 
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for fc, l = 1 , . . . , d, l 7 ^ k, where S t (X) = E [Z^ l X t | Tf) is the unnormalized 
filter of the ^-adapted process X = (Xt)te[o,T] (note that S t (Y) = £ t ). 

Iterating this procedure we obtain a sequence of parameters, whose like- 
lihood functions with respect to the initial measure are increasing and hence 
converge. Concavity implies that they converge to the maximum. 

The Euler scheme applied to versions of the unnormalized filters in ( 6 ), 
which lead to robust versions of the corresponding filters, see [5], yields for 
time steps At = tk—tk-i the approximations Ek of £t h etc.. In the correspond- 
ing equations in [9, Sect. 5] only “J2^=i( aaT ^Rl” has to be replaced by 
“AR l k ” . As approximation for the filter we use rjk = Ek/l^Ek- 

Due to the use of Girsanov’s Theorem in its derivation the continuous 
time EM algorithm cannot be extended to estimate the covariance matrix. 
So it has to be estimated before. In [9] an algorithm is presented for estimat- 
ing a constant covariance matrix very accurately. For the simple volatility 
model of Example 1 we propose the following ad-hoc algorithm, which leads 
to good results for the coefficients so>Si,S 2 , cf. Sect. 5. Due to the depen- 
dence of the volatility on the filter which is based on the estimates for £?, Q, 
the volatility would change in each step of the EM-algorithm. Therefore we 
estimate so, si, $2 separately based on the prior estimates for B , Q and repeat 
the EM-algorithm for a fixed volatility process. The algorithm in detail: 

1 ) Estimate the constant volatility using the method proposed in [9, Sect. 5]. 

2) Run the EM-algorithm once to find estimates for B , Q. 

3) Compute the approximations rjk, k = 1 ,...,iV for the filter. Sort these 
and split them into m sets (of possibly different sizes). Compute the averages 
fji of the filter values and the standard deviations < 7 * of the corresponding 
returns (divided by At 1 / 2 ) in each set (i = 1, . . . , m). Perform a quadratic 
least square fit for (fji,äi)i = to find the parameters so,si,S2. ^ e P ea f 
this step rii times. 

4) Compute the volatility process based on the estimates in 3). 

5) Repeat the EM-algorithm ri 2 times using the fixed volatility process in 4). 

6 ) Repeat 3),. . . , 5) ns times. 

5 Simulated and Historical Prices 

The following simulation and application to market data is meant to see if 
the simple volatility model of Example 1 can improve the results obtained 
assuming constant volatility. For more complex simulations (power utility, 
two stocks, but constant volatility) we refer to [9, Sect. 6 ]. We consider the 
simple model of one stock with only two states b = ( 6 i,& 2 ) T for (i and use 
U = log. Extending Corollary 1 to ^-adapted interest rates (r t )te[o,T] yields 

7 it = X t {b T r]t - r t )/<Jt , t € [0, T] . 

Simulation: We simulate stock prices for 6 years, each consisting of 252 trad- 
ing days and based on the parameter estimation over the first 5 years we 
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apply different optimal strategies in the final year. We use the algorithm 
presented in Sect. 4 with m = 23, set sizes 10,10,10,25,25,50,50,100,..., 
100,50,50,25,25,10,10,10, and n\ = 10,ri2 = 1,713 = 1. For initial param- 
eters b\ = /i + 0.5, 62 = ß — 0.5, where ßAt is the average return in the 
estimation interval, Ai = 18, A2 = 12, and 500 simulations we obtained the 
estimates in Table 1. We observe that the estimates for the volatility and the 
states are very good or reasonable but for the rates they are poor (close to 
initial values). For a discussion of comparable estimation results see [9]. 



Table 1. Parameter Estimation for Simulated Prices 



parameters 


b 1 


b 2 


Ai 


A 2 


so 


Sl 


S2 


true parameters: 


0.80 


-0.30 


15 


10 


1.0 


-3.4 


3.2 


estimated par.: 


0.70 


-0.28 


17.0 


12.7 


1.11 


-3.48 


3.29 


standard dev.: 


0.17 


0.20 


0.77 


0.44 


0.27 


1.15 


1.22 


abs. error in %: 


13.0 


7.27 


13.5 


26.5 


10.6 


2.26 


2.83 



For the optimization with initial capital xo = 1 and constant interest rate 
0.06 we compare the optimal strategy with the buy-and-hold strategy (b/h) 
of investing in only the stock. If the wealth process becomes negative in the 
optimization interval, we abort the evaluation and set the utility equal — 1. 
The results are in Table 2. Since the averages (av.) are influenced by extreme 
events we also included the medians (med.). Bankruptcy occured 3 times. 
The values using the true parameters are given in parentheses. 



Table 2. Optimal Terminal Wealth for Simulated Prices 









av. log(X(r) 


med. log (J^ t) 


strategy 


av. Xt 


med. Xt 


optimal 


2.29 (6.81) 


1.13 (1.24) 


0.19 (0.37) 


0.12 (0.21) 


b/h 


1.16 


1.14 


0.11 


0.13 



Historical prices: We consider 20 stocks of the Dow Jones Industrial Index 
and use daily prices for 30 years, 1972-2001, each with 252 trading days. We 
consider the corresponding historic interest rates (fed rates) as well. The setup 
is the same as for the simulated data, only that we now use Ai = A2 = 126 as 
initial values. For each stock the procedure (5 years estimation, 1 year opti- 
mization) is carried out with starting years 1972, 1973,..., 1996. So we perform 
500 experiments whose outcomes we average. For the optimization results in 
Table 3 we use as benchmarks also the Merton strategy using constant a 
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and /x, and the optimal HMM strategy assuming constant a (const, a). The 
parameter estimation yields on average so ~ 1.19, s\ « —3.66, 52 « 3.52, 
61 « 0.70, 62 ~ —0.39, and Ai = A 2 ~ 125.6. 



Table 3. Optimal Terminal Wealth for Historical Prices 



strategy 


av. Xt 


med. Xt 


av. log (At) 


med. log (At) 


aborted 


optimal 


1.745 


1.181 


0.122 


0.167 


1 


const, a 


1.603 


1.138 


0.057 


0.129 


11 


Merton 


1.163 


1.095 


0.006 


0.091 


2 


b/h 


1.153 


1.121 


0.116 


0.114 


- 



Conclusion: The optimal strategy based on the new volatility model 
clearly improves the optimal strategy that assumes constant volatility. This 
might be because it assigns higher volatilities to high or low values of the filter 
(as it is observed in the data), and hence extreme long or short positions are 
avoided. Volatility models with the same property should also provide good 
results, but the parameter estimation can be more difficult. 
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Abstract. In this note we present a policy iteration algorithm for constructing a 
set of efficient stationary policies containing optimal policies with respect to various 
criteria used for the mean variance tradeoff. This algorithm works both for the 
unichain and multichain models. We show that the obtained policies are optimal 
also in the class of Markovian (memoryless) policies. 



1 Introduction and Preliminaries 

The usual optimization criteria examined in the literature on stochastic dy- 
namic programming, e.g. total (discounted) or mean reward, may be quite 
insufficient to characterize the problem from the point of the decision maker. 
To this end it may be necessary to select more sophisticated criteria that 
reflects also the variability-risk features of the problem, e.g. by taking into 
account also higher moments and variance of the cumulative rewards. For a 
detailed discussion of these approaches see the review paper by White [14]. 

Some successful research on criteria reflecting the variability-risk features 
by considering the mean- variance tradeoff has been reported in the literature 
on Markovian decision models. It is important to notice, except of the papers 
minimizing the variance in the class of mean optimal or sensitive optimal 
policies (see Jacquette [2], [3], Mandl [7]), the “variance” is usually consid- 
ered only with respect to one-stage reward variances and not to the variance 
of cumulative rewards. In particular, Sobel [13] analyzed the problem of max- 
imization the ratio of the mean to the standard deviation for undiscounted 
unichain model using the methods of non-linear and parametric linear pro- 
gramming. Under the same assumptions Kawai [6] considered the problem 
of minimizing the variance subject to a lower bound on the mean. Benito [1] 
presented a recursive formula for expected cumulative reward and its vari- 
ance provided that one-stage rewards are random variables. Filar, Kallenberg, 
Huang and Lee [4], [5] proposed a mathematical programming approach to 
mean- variance Markov decision chains and unified and extended the previous 
results. Sladky and Sitaf [11] considered connections between the variance of 
cumulative and one-stage rewards, and for the unichain models established 
a policy iteration method for finding the class efficient stationary policies 
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containing optimal policies with respect to any criterion common for the 
mean- variance tradeoff. 

In this note we extend the approach used in [11] to the multichain models 
and show that policies contained in the class of efficient stationary policies 
are optimal also in the class of all Markovian (memoryless) policies. 

We consider a classical controlled Markov chain X = { X n , n = 0, 1, . . .} 
with finite state space S = {1,2,...,$}, transition probabilities p k j and im- 
mediate rewards r k j depending on the selected decision k from a finite set 
Di for every i,j e S. Obviously, r k = Y2j=iPij r ij ls expected one- 

stage reward, resp. r^ ,k = Ylj=iPij[ r ij] 2 > 0 is the corresponding sec- 
ond moment, obtained in state i G S if decision k G Di is selected and 
Ylj=i Pijl r ij ~ r i\ 2 = — [r k ] 2 is the corresponding one-stage reward 

variance. Let D = D\ x D<i x . . . x D s . We assume that the initial distribu- 
tion of the chain a = [aq, . . . , a s \ is given. 

We restrict attention on Markovian (memoryless) policies 77 controlling 
the chain, i.e. 77 = ( 7 r°, 7T 1 , 7r 2 , . . .) where n n e D for every n = 0, 1, 2, . . . and 
7rf € Di is the decision at the nth transition when the chain is in state i. A 
policy which takes at all times the same decision rule is called stationary and 
is identified by 77 ~ (7r). Let 77 ^ ~ (tt^), 77 ^ ~ (tt^) be two stationary 
policies. Then stationary policy 77 ~ (ir) selecting in state i decision 7r^ 
(resp. decision 7 r^) with probability pi (resp. 1 — Pi) is a policy arising by 
randomization of policies 77^) ~ (tt^) and 77 ^ ~ (n^). 

For what follows it will be convenient to use more condensed matrix no- 
tations. We denote by P( 7r n ) be the s x s matrix whose ij th element equals 
plj and let P m (77) = Yln=o p( ^ n ) (obviously, P n+1 (77) = P n (77)P(TT n ), 
for convenience we set P°(77) = 7, the identity matrix). If 77 (tt) (i.e. 
if 77 is stationary) then P m (77) = [P(7r)] m . Recall that the limiting matrix 
P*(7r) = lrnira^oo m~ 1 ZZolPWr ex isf s - In particular, if P(tt) is unichain 
(i.e. P(7r) contains a single class of recurrent states) the rows of P*( 7r), de- 
noted p*(7r), are identical. Similarly, r( 7r n ) = r^( 7r n ), resp. r^ 2 \ 7r n ), denotes 

7T n (2) 7 x n 

the row vector whose ith element equals r { * , resp. r\ h 1 . 

If we denote by u^’ n (77) total expected reward earned in the n next 
transitions provided the chain starts in state i and policy 77 is followed, 
then for the (column) vector of total expected rewards u^^ n (77) (whose ith 

element is u^ ,n (77)) we have v^ 1 ^ n (II) — YlkZ 0 P k (H) r(n k ). Moreover, 
p^^(77) lim n _ KX) n~ 1 v( 1 ^ n (II) (provided the limit exists) is the vector of 
the mean rewards, i.e. of the long run average expected rewards. Observe 
that the ith element of g( l \ll), denoted by p^(77), is the mean reward 
if the Markov chain starts in state i. In particular, for stationary policy 
77 ~ ( 7 r) we get v^ ,n (II) = [P(7r)] k r(7r) and for n tending to infinity 

we have g^(II) = lim^oo n -1 YlkZo [P(n)] k r(7r) = P*(7r)r(7r). If the initial 
state distribution is equal to a — [aq, . . . , a s ] the total expected reward and 
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the mean reward is given by ?/ 1 ) ,n (77) = Y^j=i a j v j 1 ^ n (^) an d by g^(JJ) = 

Y?j=i a j9j 1 \n) (or by v^ ,n (II) = a-uj 1),n (77) and by<j (1) (77) = a-e/ (1) (77), 
where • denotes the inner product) respectively. In case that P(tt) is unichain, 
the rows of P*( 7r) are identical, equal to p*{ 7r), and g ^ ( 7 r) is a constant vector 
independent of the initial state distribution a. 

Policy 77 W is called (first moment) average optimal (or mean optimal) if 
lim inf m 1 v m (n^) > liminf m 1 v m (II) for every policy U. (1) 

771 — >-00 771 — HDO 

Similarly for the second moments r^ ,k of one-stage rewards earned in state 
i under decision k e Di we have v^ ,n (II) := Ylk = 0 P k {n)^ 2 \^ k ) with 
g( 2 \ll) := lim n _^oo n _1 u^ 2 ^ n (77) (provided the limit exists); for station- 
ary policy II ~ (7r) we have # (2) (77) = lim n _+oo n _1 ^=0 [PM] k r^ (n) = 
P*{n)A 2 } (7r). In case that P(7r) is unichain g^ 2 \ll) is a constant vector. 
Policy 77 ( 2 ) is second moment average minimal if for every policy II = (7r n ) 

lim supm~ 1 v^ ,7n (n^) < lim sup m~V 2) ’ m (II) (2) 

771 — >00 m-^oo 

It is well known from the literature (see e.g. [8], [9]) that the average optimal 
policy, and hence also the second moment average minimal policy, can be 
found in the class of stationary policies, i.e. there exists ~ (fr^) (for 
£ = 1,2) such that (1), (2) is fulfilled where g^(7t^), w {£) ) i s the unique 

solution to the set of equations 

max^ 1 ^, 4^) = 0 with ^^(tt, 4)^ f [P(7r) — 7] #^(4) (3) 

tt£D 

max ( 7 r, 4 ^ ) = 0 with (7r, 7 r) r( 7r) — (4) 4- [P(tt)— 7] w ^ (4)(4) 

ttED 

where D = {n G D : max r, 4^) = 0} and P*(7t^)w(‘K^) = 0. 

7 tED 

Analogous formulas (with max replaced by min) hold for the t — 2 and 
the second moment average minimal policies. The symbol •)> •) 

denotes the zth entry of ^^(-, •), <p^(-, •)• 

After some algebra we can show that in virtue of (3), (4) (cf. ([10])) for 
any 77 = (7r n ), 77 ~ (4), £ = 1,2, and n = 0, 1, . . . 

u ( ^’ n (77) = ng w ( 4) + [I - P n (77)] w w ( 4) 

71—1 

+ Y^ pk (H) K» ■ - ' 1 - *)■ 0 ' [e) (ir* ,7t)+‘P W (Tr k ,7t)}. (5) 

k = 0 

On premultiplying (5) by the initial state distribution a = [ai,...,a 5 ] we 
have for (scalar values) ü^ ,n (77) = a • u^ ,n (7J), g^\ 4) = a • g^(4), 
(tt) = a • and p n (JJ) = a • P n (77) 

ü^’ n (77) = n§<*>(if) + w w (4) -p n (7Z>^(4) 

71— 1 

4- ^p fc (77)[(n — 1 — fc)'0^(7r /c ,7r) + <^(7r fc ,4)]. (6) 
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Moreover, for stationary iJ ^ (n) from (5) we conclude that 



n— 1 



g^M—g^\7t)= lim — P k (II)[(n— 1 — 7f) + <^^(7r,7f)]. (7) 

n— too n z ' 



k = 0 



Since the set of all stationary policies is finite, (n , 7f) + (£^(7r, 7f) is 

uniformly bounded in 7 t £ D and n if and only if ^^(tt, 7r) = 0. Hence from 
(7) it follows that if n , 7t) ^ 0 the state % must be transient under policy 

n ~ (7 r). 

Supposing that policy II = (7r n ) is followed, it is reasonable to consider 
in state i the one-stage variance as 



ZUPvtff -aPm 2 = E-=i^{[^'] 2 -2 5 : i, (i7)ry + [ 5 r , (^)] 2 } == 



( 1 )/ 



,(!)/ 



r; 



(2),^r 



-2 ff< (1 >(77)r?* +br'(IT)] 



(i)/ 



In case that II ~ (7r) on denoting by G(II) = diag {<^(17)} we conclude that 



n— 1 

f(n) ^ p‘ (tt) {r< 2 >(*r) - 2G(I7)r (1) (7r) + G(I7)g (1) (77)} 

k = 0 



= u (2) ’ n (U) - 2G(/Z> (1) ’ n (I7) + nG{n)g^\n). 



( 8 ) 



Hence the mean (one-stage) reward variance <t 2 (I7) = lim^^co n 1 y n (II) and 
from (8) we conclude that for stationary policy II ~ ( 7 r) 

ct 2 (I7) = P*(7r)r (2) (7r) - [P*(7r)r (1) (7r)] sq = s (2) (I7) - [ö r(1) (JT)] sq (9) 



([r(.)]sq results from r(-) by squaring each entry). In particular, for the ith 
element of cr 2 (II) we have of (17) = g^ 2 \ll) — [g^\ll)] 2 and if the initial 
distribution of the chain is given by a = [oq, 0 : 2 , . . . , a s ] then the corre- 
sponding mean reward variance ä 2 (I7) = J2i=i a i{di 2 \^) ~ [^^(TZ")] 2 } — 
a- fl ( 2 )(77)-a-[ ffl (1) (I7)] sq . 



2 Mean- Variance Tradeoff 

On the base of the first two moments of one-stage rewards we can formulate 
the following optimality criteria for mean- variance tradeoff in undiscounted 
Markov decision chains. Observe that by (9) for policy II = (7r n ) we have 
a 2 (n)/g?\n) = gf\n)/g^\n) -g^\H) and that a 2 {n)/[g^\n)} 2 = 
9?\n)/[g { i i \ll)]' 1 ~ 1, provided that gf\n), gf^II) exist. 

i) Weighted mean variance optimality. Considering this criterion, policy 17^ 
is called 6-weighted mean variance optimal if for every policy II — (7r n ) and 
every i G <S (with S G [0, 1] fixed) 

hf\n) = (i -s)^fi-sg^\n) > (i -^) (10) 

91 \n) g \ \n^)) 
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Moreover, if the initial distribution of the chain is given by a — [aq, . . . , a s ] 
then from (10) it follows that 7^(77) = Y^j = 1 
From (10) we immediately conclude that: 

If 8 = 1 then policy 77 ^ is (first moment) average optimal (cf. (1)); 

If S = 0 then policy 77^ minimizes the ratio of the average second moment 
of one-stage rewards to the mean reward; 

If 5 = ^ then policy = II is mean variance optimal, i.e. for every policy 
77 = ( 7 v n ) and every i G S 



h (n) - USEi 
K{ ) _ 9?\n) 



-g?\n)> 9 ^I-g?\n). 

9\ \n) 



(ii) 



ii) Square mean variance optimality. Policy 77* is called square mean variance 
optimal if 



hf\n) = 



gf\n) 



g f\m) 



> V 1 > ( 12 ) 

l £\ n )] 2 k w (#*)] 2 

for every policy 77 = (7r n ) and every i E S implying that for a given initial 
distribution a = [aq, < 22 , . . . , a 8 ] h^ 2 \ll) = 1 > h^ 2 ^(77*). 



iii) Weighted square mean variance optimality. Policy 77*’ 5 is called 5- 
weighted square mean variance optimal if for every policy 77 = (7r n ) and 
every i G S 

h?' 5 \n) = 8{gf\n) - [g^m 2 } - (1 - J)foP(ZT)] 2 > 

> 5{g?\m’ s ) - [(/{«(Ir-*)] 2 } - (1 - 6)\g?\n*’ s )] 2 (13) 

that can be also written as 

5gf\n) - [g^m 2 > 8gf{II*’ 5 ) - Ig^in*’*)) 2 . (14) 

Observe that if S = 0 we are looking for a mean optimal policy, if S = 1 we 
are looking for a policy minimizing the mean (one-stage) reward variance. 

We can easily obtain some rough bounds on the objective functions for 
the (weighted) mean variance and (weighted) square mean variance optimal- 
ity. In particular, (10), (12) and (14) respectively is bounded from below by 

(! - i?i 2) (7r (0) )/5 r | 1) (7r (0) ) - gl 2 \* (0) )/gi 1 \n (0) ) g^i^) 

and by Sg^ (tt^)] 2 respectively. 

Here 77 ~ (it 0 ) is reserved for stationary policy minimizing the ratio 
g^\ll) / g^\ll) , i.e. we are looking for optimal policies of a semi-Markov 
decision process for which if decision k G Di is selected in state i e S we 
obtain immediate return r^ ,k and the corresponding sojourn time in state 
i G S is equal to r\ (for details see e.g. [8], [9]). To obtain finer results we 
must employ more sophisticated analysis. 
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2.1 Unichain Models 



Assumption 1. P(tt) contains a single class of recurrent states for any 7 r G 
D. Observe that then g^(II), g^ 2 \ll) are constant vectors with elements 
§^(11), g( 2 \ll) independent of the initial distribution a. 



In virtue of Assumption 1, for any (nonstationary, Markovian) policy 
77 = ( 7 r n ) and any (stationary) policy 77 ~ (jr) from (5) we have for £ = 1, 2 

n— 1 

v w ’ n ( n ) = ng {t \ tt) + [I - P n ( n )] w w ( tt) + ]T P k { n )< p w ( TT k , ir ) (15) 

k = 0 

For stationary 77 ~ (7r) after some algebra we obtain from (15) 



gW(n) - gV\n) = p*(n) ■ (pf\'K,Tt) 

gW(n)-gW(n) P*{n) • ipW( 7r,7f) “ 



(16) 



being the main ingredient to the following important result depicted also in 
Figure 1. (Further details along with an algorithmic procedure for construct- 
ing vertices of the convex hull V can be found in [11]). 




Proposition 1. Consider in M 2 the setV of pairs (g^\ll),g^ (II)) for all 
(pure) stationary policies II ~ (7r) with tt G D along with the corresponding 
convex hull V. Then the adjacent vertices ofV are determined by (stationary) 
policies 7r G D that differ in the decision only for one state. In particular, for 
the pairs (g^(II^),g^ 2 \n^)), k = 0, . . . ,K, on the south-east boundary 
ofV we have 



(k) _ g(2)(/7(fc+l))-g(2) ( /7(fc)) 

K 5( 1 )(il( fe + 1 )) - ^»(ilW) 



= max max 

i€. 5 "6 D 

<p\ ' (7T,7r(k) )<0 



yfW (fc) ) 



(17) 



Theorem 1. Let 77 = (7r n ) be a nonstationary (Markovian) policy. Then: 

(i) For g^ (77), g^ 2 \ll) we have (g^(II), g( 2 \h)) G V. 

(ii) Moreover, (weighted) mean variance optimal and also (weighted) square 
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mean variance optimal policies can be selected in the class of stationary poli- 
cies 17« „ (k = 0, . . . ,K) on the south-east boundary ofV. 

Proof. To verify (i), since g^(IJ), resp. g^(IJ), is bounded from above, 
resp. from below, by g^( resp. g^fa 2 ^), let us assume existence of 
n = (7T n ) such that g {1 \n) e ), (7Z^> )] and # (2) (i7) - 

^( 2 )(77(fe)) < a(7r)W [g($ (II) —§^(11^)] (see Figure 1). Mimicking the rea- 
soning used in (15), (16), we then conclude existence of io G <S, 7r £ D such 
that ( 7 r, 7r ^ ) < 0 and (7r, ) < ä( 7r^ )<p^ (7r, ) that contradicts 

(17). Hence we can restrict our attention on the class of stationary possibly 
randomized policies. As it was shown in [11] assertion (ii) is fulfilled in the 
class of stationary policies. 



2.2 Multichain Models 

Similarly, as in the unichain case, we find (e.g. by the policy iteration al- 
gorithm) stationary policy 11^ ~ ('tt^) maximizing mean reward (observe 
that, in general, TT 1 ) ~ ( 7 K 1 )) defines a Markov chain with several recurrent 
classes). Then, extending slightly the procedure used for unichain models, we 
construct a sequence of stationary policies (for k = 0, 1, . . . , K) 

77(1) = 77(0) „ ( w (0)) > 77(1) „ ( 7r (D) ) . . . , 77« ^ (*■«), . . . ( 18 ) 

7 ^ 7 T ( fe+1 ^ for one i k € S, = 7 r| fe+1 ^ for every i ^ i k e S (19) 

using the following iterative procedure: 



Algorithm. 

Step 0. Let n^=II^ be the mean optimal policy fulfilling conditions (3), (4). 
Step 1. For k = 0, 1, . . . calculate the values a ^ where 



a^ :=max < 
ies 



max 



max 



7 r&D 



v>rW (fc) ) , 

ipj 1 ^ (tt, 7T« ) 



max 

7t€ D 

,W)<o 






( 2 ) 



(7T,7T (fe) ) 



^^(7r,7r( fe )) 



> ( 20 ) 



If a > 0 calculate the values g^( ir^) and and repeat Step 1, 

else go to Step 2. 

Step 2. For the considered optimality criterion calculate its values for all 
17« ~ ( 7T ) and select among them the optimal value. 



To verify that the above procedure generates vertices on the south-east 
boundary of the convex hull V, first observe that on premultiplying (7) con- 
sidered for £ = 1, 2 by the initial state distribution a we conclude that 



g^H 7T) - W 



= lim 



ELo jHP) K n - 1 - k ) ^ (2) ( 7r > *0 + ^ (2) (tt> *■)] 



gW(n)-gW(ir) ™ ^V(17)[( n -1- 



< max 



max 






. V 

ies jm) 



Wi 'fan) 



max 

ies 



A:)'0( 1 )( / 7T, 7 f) + (^( 1 )(7T, 7f)] 

( 21 ) 
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In particular, if 7r = (where ~ (iK 1 )) is a mean optimal mean policy) 
similarly as in the unichain case we conclude that for any policy II = (7r n ) 






< max < 
ies 



max 



w 2i (', *<*>) 



max 



<*> 7r(fe) )\w (7r> ) 



max 






( 2 ) 



(7T,7T^) 



( 1 )/ 



( 22 ) 



for fc = 0. Repeating this reasoning we can construct the sequence of sta- 
tionary policies II ~ ( 7 r^) (fc = 0, . . . , K) being the vertices of the south- 
east boundary of convex hull of all stationary policies V. Similarly as in the 
unichain case these vertices are the set of efficient points with respect to the 
optimality criteria considered for the mean- variance tradeoff. 
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Abstract. We study the process composed from random increments occurring 
at random moments. Resulting compound process is therefore characterized by 
the intensity of random time points and by the distribution of increments. We 
propose a model considering the compound process as a two-dimensional random 
point process and expressing the mutual dependence of both components via the 
multiplicative hazard regression (Cox) model. The method of estimation of model 
components is presented and the prediction of process behaviour is studied. The 
application deals with the process of financial transactions and with the problem 
of detection of atypical trajectories. 



1 Introduction, Compound Poisson Process 

The compound Poisson process is the simplest case of the processes studied in 
the present paper. It consists of the homogeneous Poisson process of random 
time points, 0 < T\ < T<i < ... with constant hazard rate h and of the incre- 
ments Yj occurring at times Tj and distributed exponentially with parameter 
g (i. e. EY = 1 /g). Moreover, all components are mutually independent. The 
resulting process can be written as a random sum C(t) — ^ Yj • 1 [Tj < t], or 
formally also as 




Y(s) d N(s), 



(C( 0)=0), 



( 1 ) 



where N(t) is the counting process corresponding to the Poisson process of 
time points. 

In the following parts, we shall generalize the model, first to the non- 
homogeneous case, then to the case with dependent components. In most 
cases, the model of compound process is given by the hazard rate of random 
point process (or of connected counting process) and by the distribution of 
increments. In the present paper we propose a model characterizing both 
process parts with the help of hazard rates and also describing their mutual 
dependence with the aid of the multiplicative hazard regression model (Cox 
model). We shall recall the methods of estimation of model components and 
the properties of estimates, namely the consistency. Further, the methods 
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of the prediction of process behaviour will be studied. To this end, the re- 
sults on crossing probabilities of risk processes (the ruin probabilities) will be 
utilized. The practical application will deal with the process of financial trans- 
actions and with the problem of detection of outlied (atypical) trajectories. 
The method uses the fact that the cumulated intensity actually represents 
also the transformation of the process to the scale of Poisson process with 
intensity one. 

In certain cases it is necessary to distinguish between the hazard rate 
(or hazard function) and the intensity. By the hazard rate of a continuous 
random variable we mean h(t) = /(£)/( 1 — F(t )), where /(£), F(t) are cor- 
responding density and distribution function. More generally, hazard rate is 
a nonnegative function characterizing the random point process. The inten- 
sity then denotes the actual rate (local conditional probability) of random 
event occurrence, it can depend on actual development of the process and its 
covariates. Then, each trajectory of the process can have its own intensity 
(though they have the same model, the same hazard rate). 

2 Crossing Probabilities for Compound Process 

We shall now recall certain relevant results from the field of insurance math- 
ematics. Let C{t) represent a process of insurance claims, they should be 
covered from a fund u + vt at time t. Then R(t) — u + vt — C{t) is the 
risk process and the event R(t) < 0 means the ruin. Hence, the problem is 
how parameters u, v (initial capital and income rate) should be selected in 
order to keep the ruin probability P( inf t R(t) < 0) less than given a (either 
on [0,T] or [0, oo)). Notice that the problem of selection of u, v is actually 
equivalent to the construction of (linear) prediction band, i. e. such a line 
that the process C(t) lies below it with probability at least 1 — a. Though 
the basic results concerning the convolution formula for ruin probability, its 
Cramer-Lundberg approximation, etc., date back to 20-ties and 30-ties of 
the last century, the problem is solved explicitly only for the simplest cases. 
Namely, for the compound Poisson process and infinite time interval the exact 
solution reads: 

P (inf m < o) = ^exp (- ( »-V9)-“ ) _ (1 _ p)e -^ (2) 

where p = (v — h/g)/v compares the growth rate of the reserve v with the 
mean of claims (per time unit) h • EY , p > 0 is the basic condition for the 
existence of solution. Hence, for given a and selected v > h/g corresponding 
u = — ln(a/(l —p))/{pg)- For instance, for the compound Poisson process 
with h = g = 1, when we select v = 1.4, we compute u = 9.31, for faster 
slope v = 1.6 u = 6.74 is obtained, etc. 

As regards the upper prediction limit for the trajectories of standard Pois- 
son process (i.e. with hazard rate h = 1 and fixed increments equal to one), 
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they can be obtained (computed or randomly generated) from corresponding 
convolution formula. Namely, the probability of crossing the line u + v • t (for 
some t > 0, u > 0, v > 1) is given by 



oo 

P(u) = (l-p)Y,P n -F {n} (u), 

n = 1 

where p = 1/v and 1 — F ^ is the distribution function of the sum of n i.i.d. 
uniform on (0, 1) random variables. Other possibility is to use the Cramer- 
Lundberg approximation P(u ) ~ (v — l)/(ru+l — v)-exp(— ru), where r is the 
positive solution to exp(r) — 1 = r • v. For instance, two of many possible 95% 
upper prediction bounds are given by v = 1.2, u = 8.17 and v = 1.4, u — 4.35. 

There exists a number of papers and monographs dealing with the ruin 
probability problem, let us mention here [2], [3], [4]. At present the research 
is focused mainly to processes with sub-exponentially distributed increments 
(i. e. distributions with heavy tails) corresponding to many real situations. 
On the other hand, the models allowing for the dependence of increments 
and times (mutual or on common covariates and history) are not so frequent, 
due many both theoretical and methodological difficulties. We shall study 
one such case and propose at least an approximate method of solution. 

3 Nonhomogeneous Compound Poisson Process 

Let the process of times N(t) be nonhomogeneous Poisson process with haz- 
ard rate h(t) and the distribution of increments Y(t) be given by hazard 
rate g(y ). We still assume that both components are independent mutually; 
this is the most serious restriction of such a model. Increments are therefore 
i.i.d. random variables, however, we describe them as a set of point processes 
Sj(y ), say, with only (maximally, in the case of censoring) one point - the 
value of increment. Denote H(t) = f* h(s)ds and G(y) = g(x) dx cumu- 
lated hazard rates. 

Let n realizations be observed in [0, T] so that the data are Ni(t ), Ci{t ), 
i = 1, . . . , n, each with time points 0 < Tu < • • • < Ti m — T, (m = ra* = 
Ni(T)), and increments Yij, j = 1, . . . ,ra^. Let us first recall the likelihood 
process of N(t): 

i= 1 U>0 

and corresponding Nelson-Aalen estimate of cumulated rate H(t ): 




ä(t) = ± f = i ± m~ ) = i ± E m < <]. (=>) 

i—1 J ® i= 1 i= 1 j 
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see also references on counting processes, e. g. [1]. Similarly, the likelihood of 
rate g(y) of increments distribution can be written as 



n rrii ( 

i-nnn«w 

i=lj=l 1 2/>0 



dSij(y) 



exp 



f 



9(y)Jij(y)dy 



where dSij(y) = 1 just at Y^ and Jij(y ) are random indicators, Jij(y) = 1 for 
0 < y < Yij, Jij(y) = 0 otherwise. Hence, at fixed y, J(y) = Yh=i Yij Jij(y) 
is the number of increments larger than y ( J(y ) is called the risk set in the 
field of survival analysis). Again, the estimator of Nelson- Aalen type for G{y) 
yields 




d Sij(x) 

ELi EiJkiix) 



< y) 



These estimators are consistent (uniformly on each bounded interval [0, T] x 
[0,Y]) and asymptotically normal (in the sense of convergence of properly 
normalized residual process to the Wiener process). Estimates of hazard rates 
h(t) or g(y) are as a rule computed with the aid of kernel smoothing of 
increments AH’(T^), AG (Yij). 



4 Model with Time-Dependent Increments 

Let us now consider the case that increments depend on the time of their 
occurrence. Hence, the process is described by hazard rates h(t) and g(y,t), 
time t acts as a covariate for hazard rate of increments. We again assume 
that n processes Ni(t), Ci(b) are observed in [0,T] x [0, oo] fully, without 
censoring, so that corresponding indicators are Ii(t) = 1 on [0, T], Ji(y; t) = 1 
for y G [0, Yi(t)\ provided Yi(t) is an increment of i- th process at t , zero 
otherwise. We also assume that functions h and g are bounded, it follows 
that the risk set J(y) = / Q T Yl^=i diVi(£) is Op(n) uniformly for each 

y E [0,Y], each finite Y. In other words J(y)/n has a P-limit uniformly 
greater than zero and bounded, on [0, Y], when n increases to infinity. 

As regards the statistical analysis, the estimate of cumulated hazard rate 
H(t) = f Q h(s) d s can be obtained from the Nelson- Aalen estimator as in (3). 
Hazard rate of increments is a function of two variables. There exist quite 
general methods of its estimation, for instance the method of nonparametric 
estimation of doubly-cumulative hazard rate, [5] (the estimate is actually of 
Nelson-Aalen type w.r. to y and of kernel type w.r.to t). In the sequel, we 
shall consider the Cox model specification of g{y\ t). 

4.1 Proportional Hazard Model for Increments 

Let us assume that the hazard rate of distribution of increment at time t can 
be written as 



y{y,t) = 9o(y) ■ e b(t) , 



(4) 
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where go(y) is a baseline hazard rate and b(t) is a (nonparametric, in general) 
response function. It is seen that functions in (4) are not given uniquely, some 
normalization is necessary. For instance we can keep b(to) = 0 at a chosen 
point to- Standard case deals with a parametrized function &(£), nonpara- 
metric maximal likelihood can be solved via the local scoring method. The 
simplest approach uses a histogram-like estimator of b(t ), i. e. taking b(t) = b r 
constant in selected intervals r = 1, . . . , m, dividing [0, T] (while it is as- 
sumed that the actual unknown b(t) is a continuous function). The constants 
b r are obtained from the maximization of the logarithm of Cox partial like- 
lihood 



Lp — 




e bs J(y,s) 



d S(y,r), 



(5) 



where S(y,r) is now the counting process of increments in the time interval 
%. Finally, cumulated baseline hazard rate Go(y ) = Jq go(x) dx is estimated 
with the aid of the Breslow-Crowley estimator as 



G 0 (y) 



i:± 

r— 1 



d S(x,r) 

T,T=i ebr J(x,s) 



( 6 ) 



Let us remind here that the piecewise constant function b(t) has here also the 
character of heterogeneity variable describing the departures of distribution 
of increments in certain time intervals from the baseline distribution given 

by go(y)- 

Naturally, the assumption on proportional hazard should be verified, the 
tests of proportionality of two subsamples as well as the goodness-of-fit test 
for Cox model are available, [1]. 

As regards the asymptotic properties, i.e. the situation when n — ► oo, 
it is as a rule assumed that the number of histogram intervals m = m n — * 
oo and n/m n — > oo, too, Under certain more-less technical conditions the 
consistency of estimation can be proven. The theory for parametrized case is 
already well developed (see again [1]). The asymptotics for the more complex 
nonparametric case can use several sources. One of them is based on already 
mentioned results of [5] and their specific approach to solution for a general 
model. Another way leads from the theory of consistent spline models derived 
by C. Stone, e.g. [6]. The histogram approximation is actually a special case 
of spline model. 



5 Example 

As an example, we analyzed the processes of credit cards payments at a hotel. 
One process corresponded to payments on one day, data are from n = 90 days, 
t G [0,24] hours. Figure 1 shows a selection of realized processes Ni(t) and 
Ci(t), together with estimated cumulated rates H(t) and AT(t), actually the 
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Counting processes, 5812 — No of transactions per 1 day 




Cumulative processes - cumulated amounts per 1 day 




means from observed trajectories. Certain interesting trajectories are denoted 
by their numbers. The estimates indicate that the frequency of increments as 
well as their magnitude depend on time. No other covariates are considered, 
we assume that the model of preceding section describes the case sufficiently. 
Graphical test confirmed a good fit of the model to our data. 

The time period [0, 24] hours was divided to 24 one-hour intervals. The 
piecewise constant estimator b r has been obtained from (5), then it was 
smoothed by a moving window. The result is on the lower subplot of Figure 
2. We kept b\ = 0 in order to guarantee uniqueness of solution. Further, the 
cumulated baseline rate estimate Go(y) has been computed along (6), its plot 
is in the upper subplot. Finally, we constructed approximate upper predic- 
tion lines both for numbers and cumulation of increments. For all trajectories 
their actual times and increments are available and the model has been just 
estimated. Hence, actual behaviour of observed trajectories can be at once 
compared with their expected behaviour derived from the model. More pre- 
cisely, if a process has times Tj and increments Yj = Y(Tj ), and model with 
H(t) and G(y; t) is the right one, then times Tj = H(Tj ) should be the times 
of Poisson (1) process and values 7 j = G(Yj,Tj) should be the values corre- 
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sponding to Exp(l) distribution. Therefore, the scale of each trajectory Ci(t) 
can be transformed to the scale of compound Poisson (1,1) process. The re- 
sults of such transformation, for four interesting trajectories, is displayed in 
Figure 3, in the first subplot. The dashed line is the 95% prediction line 
u + vt, u = 9.308, v — 1.4 (computed in section 2). 



Estimated characteristics of distribution of increments, 581 2 





time t 

Fig. 2. Estimated cumulated baseline rate Go(y) and response function b(t) 



Simultaneously, in subplot 2 of Figure 3, we compared also corresponding 
counting processes with the upper 95% prediction line u+vt, u = 8.17, v = 1.2 
(again one of those derived in section 2). The diagnostics revealed several 
trajectories with (not extremely) outlied character consisting mostly in that 
the cumulated sum crossed the prediction line. Naturally, the more convenient 
variant of diagnostics should use the cross-validation, i.e. the model evaluated 
only from trajectories not selected for the test. 

6 Conclusion 

The main purpose of the paper was to offer a simple model for the cumu- 
lative processes consisting in the combination of the counting process with 
random increments dependent on it and to show an application to the analy- 
sis of stream of financial transactions. Successful use of such models requires 
the development of the methods for estimation of the model characteristics 
and also the methods for the prediction of process behaviour under different 
conditions. Then we are also able to classify the processes and, eventually, 
to detect atypical ones. The practical application for instance to the fraud 
detection problem is quite straightforward. 
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Transformed compound and counting processes, 95% prediction lines: 
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Abstract. The minimum weight design of structures made of fiber reinforced com- 
posite materials leads to a class of discrete optimization problems for which evolu- 
tionary algorithms (EAs) are well suited. Based on these algorithms the optimiza- 
tion tool package GEOPS has been developed at TU Dresden. 

For each structure generated by an EA the structural response has to be evalu- 
ated. This is often based on a finite element analysis, which results in high compu- 
tational efforts for each single structure. Typical runs of EAs require the evaluation 
of thousands of structures. Thus, an efficient approximation of the structural re- 
sponse could improve the performance considerably. To achieve this aim, the use of 
a support vector machine (SVM) is suggested in this paper. 

As an example for a typical aircraft structure, a stiffened composite panel under 
compressive and shear loading is considered. Buckling as well as strength constraints 
are taken into account. The SVM is trained on geometrical and material data. 
Representing the design space of composite panels by ABD matrices turned out to 
be a valuable means for obtaining well trained SVMs. 



1 Introduction 

Primary objectives concerning the development of next generation commer- 
cial transport aircrafts are to reduce the manufacturing costs and the struc- 
tural weight considerably. A promising way to achieve these aims is to extend 
the application of fiber-reinforced composite materials. The use of laminated 
composites leads to a substantial increase in design parameters. Hence, min- 
imum weight solutions for more complex structural components such as stiff- 
ened fuselage panels and wing skins can be obtained only by using numerical 
optimization methods combined with finite element codes. 

The optimization of stiffened panels made of laminated composites is 
characterized by a combination of continuous and discrete design variables. 
Typical examples of discrete parameters are the ply thickness and the ply ori- 
entations. Caused by production constraints the plies of the skin and stiffener 
laminates in real structures usually have to be chosen from a finite number 
of thicknesses and a limited set of ply orientations such as 0, 90 and ±45 
degrees. The number and type of stiffeners are discrete parameters, while the 
stiffener height is a continuous design variable. These mostly discrete design 
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variables restrict the use of traditional continuous optimization techniques. 
In the last decades techniques based on natural evolution principles have 
been introduced to deal with this type of optimization problems. A combina- 
tion of such techniques [10], namely of evolution strategies (ES) and genetic 
algorithms (GA), is implemented in the optimization package Genetic and 
Evolutionary Optimization of Structures (GEOPS) developed at the Insti- 
tute of Aerospace Engineering [3]. 

The optimization of the laminate stacking sequence using evolutionary 
algorithms is the subject of several recent studies [2,5,8,9,11]. In [11] sandwich 
structures with composite facesheets are investigated whereas panels with 
discrete stiffeners are dealt with in the other references. Except the papers 
related to GEOPS [2,3,11] only GA-type algorithms have been used. 

The optimization of stiffened composite panels involves constraints such 
as strength failure or buckling. Frequently, closed form solutions (as given 
in [4]) are used to compute constraint values. However, this approach is re- 
stricted to simple panels. To obtain a reliable evaluation of more complex 
structures a finite element (FE) code has to be employed. In [2] such a nu- 
merical analysis is suggested for all structures occurring during the whole 
evolutionary optimization process. Of course, this can be very expensive in 
terms of computation time. 

To overcome this drawback several concepts have been developed recently. 
In [9] a FE analysis is carried out for a number of randomly generated struc- 
tures. Then, a neural network provides approximations for constraint values. 
A composite wing structure is dealt with in [5] by a two-level design proce- 
dure. Before entering the upper level an approximation of the buckling load 
by means of a response surface method is provided in the lower level. Then, 
for some structures generated in the upper level a FE analysis is performed, 
but without feedbacks to the lower level. 

In this paper a new approximation concept for saving FE computations 
will be suggested. A support vector machine (SVM) is used to separate the 
design space into a feasible part (where all constraints are satisfied) and an 
infeasible one. Based on a certain distance to the separating surface provided 
by the SVM an approach to define the fitness function used in the evolution- 
ary algorithm is presented. Although SVMs have been widely investigated in 
recent years (for an overview see [1,7]) we are not aware of applications for 
structural optimization. 

2 Structural Optimization and Evolutionary 
Algorithms 

The aim to improve or to optimize a structure presumes the potential for 
changes of the structure. Here, this potential is expressed by means of design 
variables X{ with i = 1, . . . , n. The design vector x := (aq, . . . , x n ) T controls 
the geometry and material properties of the structure. Depending on its role 
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the design variable Xi can take either continuous or discrete values in a certain 
range, i.e., Xi G Di C R for i = 1, . . . , n. Then, 

V := Di x • • • x D n C R n 

denotes the design space. Any element of V corresponds to a particular struc- 
ture and vice versa. Of course, there are other restrictions a structure has to 
satisfy. They stem from structural limits like allowable stress and strain, max- 
imum deformations and buckling loads. If a structure x G V satisfies these 
restrictions it is called feasible and belongs to the set T C V of feasible struc- 
tures. To compare structures to each other an objective function f :V R 
is used, for example the weight or production cost. 

The structural optimization problem of finding a feasible structure x * 
which minimizes (or maximizes) the objective function / over the feasible set 
T is, for short, written as 

f(x) — > min subject to x £ T. (1) 

To apply an evolutionary algorithm (that generates both feasible and infea- 
sible structures in the design space V) problem (1) is often replaced by a 
problem over V. Therefore, the violation of the restriction x £ T is penalized 
by means of a certain penalty function p : V — > [0, oo) and problem (1) is 
replaced by 



4>{x) := f(x) + p(x) — > min subject to xeV. (2) 

An optimization aims at finding a design vector x (i.e., a structure) with a 
minimal value of the fitness function <fi : V — » R. 

Evolutionary algorithms are promising methods to treat complex prob- 
lems with discrete and continuous design variables. They mimic the biological 
evolution process. In each iteration a population of individuals is generated. 
Here, an individual represents a particular structure x in the design space V. 
As the iteration process goes on the populations evolve, taking into account 
that certain characteristics of the parent population are passed to the off- 
spring population. Structures with better fitness function values have better 
chances to survive or to pass certain characteristics to an offspring popula- 
tion. 

Our investigation is based on the implementation of an evolutionary al- 
gorithm in the software package GEOPS [3]. The structure of this algorithm 
is given in Fig. 1. A part of the offspring population is created by using ES 
operators and another part by means of GA operators. The main differences 
between these two types of operators lie in the handling of design variables. 
ES operators directly work on the design variables whereas GA operators are 
applied to a coded form of the design variables as a binary string. For more 
details about the optimization with ES and GA see [2,3,10,11]. 

The algorithm shown in Fig. 1 generates many populations, resulting in a 
huge number of structures. For each structure the violation of the constraints 
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Parent population 



ES: mutation, recombination 
GA: crossover, mutation 
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| Optimal or suboptimal designs | 
Fig. 1. Evolutionary optimization 
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Fig. 2. Approximation concept 



has to be evaluated, often by means of an expensive FE analysis. To reduce 
the resulting computational effort significantly we suggest an approximation 
of the overall constraint violation of every individual that occurs within cer- 
tain intermediate populations. The approximation is done by means of a sup- 
port vector machine (SVM), which is described in Section 3. At the beginning 
of the optimization process no populations with exactly computed constraint 
violations are generated. Then, n a populations with approximate evaluation 
of the overall constraint violation and n e populations with exactly computed 
constraint violations alternate, see Fig. 2. Of course, after each cycle with 
exact evaluation the training data for the SVM is updated to improve the 
approximation quality. 



3 SVM Classification and Approximation Concept 

Any function c: £>—►{— 1,1} divides the design space V into the disjoint 
sets 



1>+ := {x eV\ c(x) = 1} and D_ := {x eT>\ c{x) — —1}. 

The function c is chosen so that = T is the set of feasible and —V\T 
the set of infeasible design vectors. Only for m training data points Pi G V 
(i = l(l)m) the values c(pi) are assumed to be known. Then, the set of 
training data points, denoted by T, decomposes into the disjoint subsets 

T+ := {Pi \c(pi) = l,i = 1(1)to} and T_ := {p, |c(p<) = -l,i = l(l)m}. 

Based on the training data information a SVM classifies any point x £ D, 
i.e., provides an estimate for c(x). In some cases, this value might be false. In 
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principle, a SVM computes a hyperplane in R n to separate the sets T+ and 
T_. In general, such a hyperplane does not need to exist. Therefore, R n is 
mapped into a higher dimensional space H so that the images of T+ and T_ 
in H can be separated by a hyperplane in H. Among all such hyperplanes a 
SVM chooses one with some maximal distance to the images of both T+ and 
of T_ . This hyperplane in H then induces a surface in R n that separates T_ 
and T+ and divides V into two subsets. With the (m, n)-matrix P containing 
pf as rows and the diagonal (m, m)- matrix C with the diagonal entries c(pi) 
(i = l(l)m), any pair (u, 7 ) G R n+1 defines a surface 

{x G R n I K(x, P T )Cu -7 = 0}. (3) 

Here, K(X,Z) := ( k(xi,Zi )) depends on X := (asi, . . . ,a^) T G R^ xn and 
Z := (zi, G R nx/ . For k : R n x R n —> R the Gaussian kernel 

k(x, z) := exp(—p\\x — z\\%) V®, z G R n (4) 

is chosen with a fixed parameter fx > 0. The pair (u*, 7 *) is obtained as 
solution of the following SVM (with e:=(l,...,l) T G R m ) 

viWVxWl + V2WV2WI + 7 2 + HI 2 min 

(5) 

s.t. C(K(P , P T )Cu - 7 e) + y>e. 

The vector y G R m of slack variables allows some training data points to be 
misclassified in order to enable a better separation of the remaining ones. The 
subvector y\ (2/2) contains the components yi of y for which pi is feasible 
(infeasible). Smaller misclassification errors ||j/*| || and \\y 2 W 2 can achieved 
by larger penalization parameters v 1 , z /2 > 0 in (5). 

Having a solution (u*,j*,y*) of the SVM (5) the surface (3) yields an 
approximate classification of design vectors x G V into feasible and infeasible 
ones. If K(x, P T )Cu* — 7 * > 0 , then x is regarded as feasible, otherwise 
as infeasible. Moreover, we would like to approximate the overall constraint 
violation for any design vector x gD. For this purpose, the expression 

d(x) := max{0, —(K(x, P T )Cu* — 7 *)} \/x G V. 

is involved. Then, d(x) = 0 if x is classified as feasible. Otherwise, d{x) > 0 
and the value d(x) can be regarded as a measure for the distance of x to 
the set T of feasible design vectors. Therefore, d(x) estimates the overall 
constraint violation and will be used to define the penalty function p by 

p(x) := exp (ad(x)) — 1 Mx G T* 

with a fixed a > 0. Thus, the fitness function 4> (see (2)) is well defined for 
all design vectors x generated in a phase of approximation. In a phase where 
the constraint violations are computed exactly these violations are explicitly 
used to define p. 
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4 The Design Vector 

Every structure in the design space V is represented by a design vector x. 
The components of the vector provide information both on geometrical data 
(like the number of stiffeners or their height) and on material data of the lam- 
inates used for the skin and the stiffeners. A laminate is a sequence of single 
plies arranged on top of each other. Commonly, these plies are reinforced by 
unidirectionally orientated fibers embedded in a polymer. 

For a successful application of the SVM the discrete structure of the 
laminates is replaced by an integral model. Based on the classical lamination 
theory [ 12 ] the material data are represented by the so-called ABD-matrix. 
This stiffness-matrix relates the forces Ni and the moments Mi applied to a 
laminate to the mid-plane strains 7xy0 and the curvatures Ki (see Fig. 3 ): 
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The A and D submatrices are the extensional and flexural stiffness matrices, 
respectively. Submatrix B is called the bending-extension coupling matrix. 
Making use of the symmetry of the ABD matrix each laminate is represented 
by 18 parameters. 




5 Numerical Test Example 

A blade stringer stiffened composite panel (length 1500mm, width 1047mm) 
under compressive and shear loading (N x = — 132N/mm, N xy = 220N/mm) 
is considered. Skin and stiffeners consist of unidirectional graphite/epoxy 
prepregs with 0, ± 45 and 90 degree orientations. The design vectors contain 
number and height of stiffeners and the material data for the laminates of 
skin and stiffeners. To define the feasible set T C V strength and buckling 
constraints are taken into account. 
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The influence of the SVM parameter v\ (see (5)) and of the Gaussian 
kernel parameter /jl (see (4)) on the rate of misclassification of design vectors 
by the SVM has been studied (v 2 was always set to 0.05 v\). After no := 12 
exactly evaluated populations two cycles each with n a := 10 approximate 
and n e := 5 exact populations follow. At the end, 3 exact test populations 
are generated to check the quality of the approximation provided by the last 
SVM. In every population, 24 offspring individuals are created based on the 
design information of 10 selected parent individuals. GEOPS also features 
techniques to avoid the loss of good feasible structures during approximate 
populations, to detect certain wrongly classified structures, and to amplify 
the penalization. 

The misclassification rate over all approximate populations (Table 1) and 
over the last 3 test populations (Table 2) is given as a mean percentage over 
10 runs of GEOPS. Based on this study (see [6]), the parameters v\ — 10 4 



Table 1. Misclassification rate in the 
approximate populations in % 



Vl 


ß = 0.002 
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5 


50 
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12.4 


21.8 


38.8 


100 
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19.1 
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10 4 


14.0 


8.1 


21.8 
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9.4 
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19.6 


38.2 



Table 2. Misclassification rate in the 
test populations in % 



V\ 


ß = 0.002 
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50 


10 




6.2 


9.0 


14.9 


100 




6.5 


9.6 


17.6 


10 4 


7.9 


3.2 


7.2 


18.1 


10 6 


6.0 


6.5 


8.2 


18.5 



and ju = 0.2 are chosen for further investigations. The best fitness function 
values of each population obtained in 5 runs of GEOPS are shown in Fig. 4 
for exactly evaluated populations and in Fig. 5 for cycles with exact and 
approximate populations. Regardless whether approximate populations are 




Fig. 4. GEOPS with exact evaluations Fig. 5. GEOPS with approximate eval- 
only uations by means of SVMs 



involved or not the optimization processes lead to structures with similar 
weights. Of course, there is no guarantee of optimality, i.e., a feasible struc- 
ture with less weight might exist. In the runs with SVM based approximate 
populations the number of exactly evaluated structures reduces from 1090 
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to 630. Further substantial savings of computation time are expected from 
developing more sophisticated combinations of exactly and approximately 
evaluated structures. 
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Zusammenfassung (Probabilistische) Konditionale stellen ein Kommunikations- 
instrument dar, mit dem Wissen in einer reichen Sprache vermittelt werden kann. 
Ziel dieses Artikels ist es aufzuzeigen, wie die Konditionalsprache erweitert werden 
kann, um auch Sprachgefüge mit temporalem Kontext auszudrücken. Zur Verarbei- 
tung des Wissens dient das axiomatisch fundierte Entropieprinzip. Anhand eines 
Beispiels mittlerer Größe werden die theoretischen Überlegungen in der Expertensys- 
tem-Shell SPIRIT näher illustriert. 



1 Einführung 

In Erweiterung der klassischen Aussagenlogik etablierte sich in den letzten 
Jahren eine probabilistische Konditionallogik, die sich zur Inferenz des Prin- 
zips Maximaler Entropie (MaxEnt) bedient [1], [6]. Zur Berücksichtigung 
temporal-logischer Aspekte finden sich u.a. Ansätze erweiterter Modallogiken 
[3], Intervalllogiken [4] oder Verzweigungslogiken [10]. In dem vorliegenden 
Beitrag wird der MaxEnt - Inferenzprozess um temporale Elemente angerei- 
chert, die weitgehend dem menschlichen Sprachgefühl entsprechen. Der ge- 
samte Ansatz basiert auf der Verwendung von Zeitkonditionalen, mit deren 
Aktivierung oder Inaktivierung der gesamte Zeitstrahl von Zeiten in der Ver- 
gangenheit bis hin in die Zukunft durchlaufen werden kann. Die Modellierung 
erfolgt in der Expertensystem-Shell SPIRIT, mittels derer der Zeitprozess an- 
hand eines Beispiels demonstriert wird, vgl. [9]. 

2 Grundlagen 

2.1 Probabilistische Konditionale 

Es sei C eine propositionale Sprache, bestehend aus einer endlichen Menge 
endlichwertiger Variabler V = {Ül,....,V^} mit Werten Vj = Vj. Proposi- 
tionen in C sind wohlgeformt aus Literalen Vj = Vj, aus den Junktoren A 
(und), V (oder), ” (nicht) und entsprechenden Klammern; solche proposi- 
tionalen Ausdrücke werden mit A, B,C, ... bezeichnet. Bei Konjunkten wird 




420 



der Junktor oft unterdrückt: AB = A A B. Vollständige oder einfache Kon- 
j unkte von Literalen schreiben wir als ungeordnete Tupel, wie zum Beispiel 

v = vi...v n . 

| ist der binäre Konditionaloperator. Ausdrücke der Form B\A heißen Kondi- 
tionale oder Regeln, sie bilden die Sprache C\C . Propositionen A E C werden 
mit Konditionalen A\T identifiziert, wobei T irgendeine Tautologie ist. Kon- 
ditionale können wiederum konditioniert werden. Der hier benötigte einfache 
Fall ist der, der Konditionierung unter einer Präposition (B\A)\C mit der 
Bedeutung (B\A)\C = B\AC. Über weitere Eigenschaften von C\C vgl. [1]. 
Den Konditionalen werden Wahrscheinlichkeiten x E [0; 1] zugewiesen. Somit 
besteht die Syntax aus Objekten der Form B\A[x], A,B E C und x E [0; 1]. 
Ein semantisches Modell ist eine Verteilung P auf C. In P ist ein Sachverhalt 
J5|A[x] gültig, P \= B\A[x], genau dann wenn P(BA) = x • P(A). Sind in 
P mehrere Konditionale 1 Z = {Bi\Ai [xi\, i = 1,...,/} gültig, schreiben wir 
kurz P \=1Z. Sind sämtliche Konditionale Bi\Ai [xi\ unter C zu konditionie- 
ren, also Bi\AiC [xi], notiert man das einfach als 1Z\C. 

2.2 Das Entropieprinzip 

Wissen in Form einer Menge von Sachverhalten 1Z = {Bi\Ai [#*], i = 1, ..., /} 
wird in diesem Beitrag entropieoptimal durch Lösen der Aufgabe 

P* = argma xH(Q) = - ' lo §2 <2( v ) (!) 

V 

u. d. N.: Q erfüllt ft (Q f= ft) 

verarbeitet [6]. Das Prinzip Maximaler Entropie haben verschiedene Auto- 
ren unabhängig voneinander axiomatisch fundiert; man vergleiche hierzu [2], 
[7]. Die auf diese Weise erzeugte Verteilung P * ist gerade jene unter allen 
Verteilungen Q , in der alle in 1Z explizit formulierten - und keine weiteren - 
Abhängigkeiten repräsentiert sind. Die in (1) formulierte Optimierungsaufga- 
be garantiert somit eine informationstreue Wissensverarbeitung. Liegen nun 
situativ gültige Sachverhalte IZe vor, so wird das bekannte Wissen aus P* 
durch Lösen der Aufgabe 

P** = argmini?(<5, P*) = 

u. d. N.: Q\=K e 

informationstreu an das neue Wissen aus IZe adaptiert. Man vergleiche hier- 
zu auch [6]. Im folgenden Abschnitt wird gezeigt, wie die probabilistische 
Konditionallogik um temporale Elemente erweitert werden kann. 

3 Abbildung von Zeitformen durch Konditionale 

Wir betrachten eine Wissensdomäne über einem Zeithorizont, wie in Abbil- 
dung 1 dargestellt. Dabei bezeichnet t den Zeitpunkt der Gegenwart, t — 2 
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Vergangenheit Zukunft 

<— — — > 

b2 t-1 t t+1 t+2 > 



Abbildung!. Modellhorizont 



und t — 1 bezeichnen Zeitpunkte der Vergangenheit sowie t + 1 und t + 2 
Zeitpunkte in der Zukunft. Eine Verallgemeinerung auf mehr als zwei ver- 
gangene oder zukünftige Zeitpunkte ist trivial, soll aber hier aus Gründen 
der Übersichtlichkeit unterbleiben. Es sei 7 Z t+T eine Menge von Sachverhal- 
ten, die zum Zeitpunkt t + r mit r = —2, —1, 0, 1, 2 bekannt wurden, werden 
oder (vermutlich) in Zukunft zufließen werden. Desweiteren bezeichnen W t + T 
binäre (Zeit-) Variable. Dann sind 7^t +r |Wt +r unter den Wt+ r zeitkonditio- 
nierte Sachverhalte, die im folgenden kurz Zeitkonditionale heißen. 

Ziel ist es nun, eine Wissensbasis zu erzeugen, die eine Erinnerung an vergan- 
gene Wissenszustände und eine Vorwegnahme zukünftiger Zustände — unter 
Einbeziehung vermutlich richtiger noch zufließender Sachverhalte — gestattet. 
Dabei besteht das Wissen zum Zeitpunkt t + r aus der Aggregation aller bis 
dahin erlernten Sachverhalte l^t -2 U • • • U7^ +r . Dazu setzen wir voraus, dass 
sämtliche bis in t + r erworbenen Sachverhalte untereinander konsistent, d.h. 
widerspruchsfrei sind. Für den Fall widersprüchlicher Sachverhalte geben die 
Autoren in [5] eine Methode an, wie Inkonsistenzen aufgelöst werden können. 
Hierauf wird in dem vorliegenden Artikel aber nicht näher eingegangen. 

Der temporale, entropieoptimale Wissensverarbeitungsprozess vollzieht sich 
nun in drei Schritten. 

1. Formulierung von Zeitkonditionalen 

t-2:{K t - 2 \W t - 2 ) 

t-li{Kt-2\Wt- 2 UKt-i)\W t -i 

t : ((Kt-2\W t -2 U nt-i)\W t ^ u n t )\w t 

2. Abbildung des chronologischen Ablaufs 

n c := {Wt+r-^Wt+r [l.o] } für t = -1, 2. 

In Verbindung mit den Zeitkonditionalen unter 1. wird mit den Regeln 1Z C 
sicher gestellt, dass sowohl die zum Zeitpunkt t + r erworbenen Sachver- 
halte als auch sämtliche zeitlich früher erworbenen berücksichtigt werden. 
Die Wissensverarbeitung erfolgt im nächsten Schritt. 



3. Lösen der (temporalen) Inferenzaufgabe (n) 
Pf z j_ 2 = argmaxiJ(Q) 



( 3 ) 
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u. d. N. : Q \= 1Zt-2\Wt-2 U ( lZt- 2 \Wt -2 U lZt-i)\Wt~i U • • • U 7£ c 

Die Verteilung P^ ±2 birgt das über die einzelnen Zeit stufen t — 2 bis 
t + 2 erworbene Gesamtwissen, aus der sich nun jeder Wissensstand zum 
Zeitpunkt t + t mit r = —2,..., 2 abrufen lässt, indem die Zeit variable 
Wt+r aktiviert und Wt+ r + 1 ausgeblendet wird. Formal entspricht das der 
Lösung der Aufgabe 

Pt +T = arg min R(Q; P t * ±2 ) (4) 

u. d. N. : Q b Wt+r [1.0] U Wt+r+i [0.0]. 



(4) ist ein Spezialfall von (2), allerdings erfolgt die Lösung in der Experten- 
system-Shell SPIRIT durch einfaches Anklicken der Werte W* +r = 1 und 
W t + T + 1 = 0, vgl. auch Abbildungen 2 bis 5. 

Um beispielsweise den gegenwärtigen Wissensstand P t * (r = 0) abzurufen, 
wird die entsprechende Zeit variable W t aktiviert (W t [1.0]), was wegen des 
im 2. Schritt formulierten chronologischen Ablaufs auch W t ~ 2 und Wt - 1 
aktiviert. Zudem wird die Zeit variable Wt+i ausgeblendet (Wt+ 1 [0.0]), wo- 
durch sich die Zeitvariable Wt+2 mit ausblendet. Durch das Aktivieren und 
Ausblenden der Zeitvariablen wird sichergestellt, dass in P t * nur die zum 
Zeitpunkt t erworbenen Sachverhalte 7 Zf und die zeitlich früher erworbenen 
Ut -2 U 7lt - 1 gelten; alle zu späteren Zeitpunkten noch erfahrbaren Sach- 
verhalte Ht+i und 7^+2 bleiben unberücksichtigt. Entsprechend lassen sich 
Wissensstände auch zu allen anderen Zeitpunkten innerhalb des Modellhori- 
zonts abrufen. 

Die etwas aufwendige Indizierung t -f r wurde gewählt um zu verdeutlichen, 
dass auch t eine sich im Zeitablauf verändernde Variable ist. Mit dem Über- 
gang t = t + 1 wird natürlich r zu r — 1. 

Im nächsten Abschnitt werden die theoretischen Überlegungen anhand eines 
Beispiels erläutert. Statt der aufwendigen Relativindizierung werden jetzt 
einfach die Zeitpunkte —2, —1, 0, 1, 2 betrachtet. 

4 Ein Beispiel 

Das folgende Beispiel, bekannt unter “Lea Sombe “ wird in [8] erstmals vorge- 
stellt. Es wird im Folgenden um weitere Modellvariable und Zeitkonditionale 
erweitert. Über einen Zeitraum von —2,— 1,0, 1,2 betrachten wir in einer 
fiktiven Population folgende Eigenschaften: 

J = j , n: Jung sein: ja, nein, 

S = j,n: Student sein: ja, nein, 

F = 5, u, e: Familienstand: single, verheiratet, eheähnliches Verhältnis, 

E = j,n: Elternteil sein: ja, nein. 
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Desweiteren seien LEA und COND zwei ausgezeichnete Individuen in dieser 
Gesellschaft. 

Zum Zeitpunkt —2 gelten folgende Sachzusammenhänge : 90 % aller Studen- 
ten sind jung , 30 % junger Menschen studieren , LEA ist Single. In der hier 
verwendeten Symbolik: 

K- 2 = {J = j\S=j[0.9], S=j\J=j[0.3], F = s\LEA[1.0]}. 

Weitere Sachzusammenhänge mögen zu den verschiedenen Zeitpunkten be- 
kannt werden, sie sind nachstehend aufgeführt. 

ft_i = {F=s | J=j [0.8], J=j | F=s [0.7], J=j | F=e [0.8], E=j | LEA [1.0]}. 
IZo = {F=e V F= v | S=j A E =j [0.9]}. 

Th = { E=j | J =j A S=j [0.01], F=v | COND [1.0]}. 

U 2 = {S=j | E =n A J=j [0.95], E=j \ COND [1.0]}. 

Mit diesen Sachverhalten zuzüglich der Regeln 7 Z c für den richtigen chro- 
nologischen Zeitablauf lösen wir Aufgabe (3) und erhalten so eine Wahr- 
scheinlichkeitsverteilung als Wissensrepräsentanten, aus der sich das bis zu 
den einzelnen Zeitpunkten erworbene Wissen durch Aktivierung und Aus- 
blendung entsprechender (Zeit-) Variabler W T ableiten lässt. 




Abbildung2. Gegenwärtiger Wissensstand. 



a) Wir wollen Wissen zum Zeitpunkt 0 abfragen. Dazu wird die Zeitvariable 
Wo aktiviert, was unmittelbar auch die Aktivierung von W- 2 und W - 1 
mit sich zieht; W\ wird ausgeblendet und somit auch W 2 . Damit erfahren 
wir, dass zum gegenwärtigen Zeitpunkt in der Gesamtpopulation ca. 83 % 
aller Studenten mit Kindern jung sind (P$ (J = j\S = j AE = j) = 0.83). 
Das zeigt der Bildschirmausdruck aus SPIRIT in Abbildung 2. Diese Aus- 
sage ändert sich jedoch signifikant, wenn zukünftige Entwicklungen mit 
berücksichtigt werden. So werden zum Zeitpunkt 1 wohl nur noch knapp 
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Abbildung3. Zukünftiger Wissenstand. 



16 % aller Studenten, die Kinder haben, jung sein (P* ( J = j\S = j AE = 
j) =0.16), vgl. Abbildung 3, will man der vermeintlich zukünftig zuflie- 
ßenden Information Glauben schenken. 



Während hier Zusammenhänge über Eigenschaften nicht näher in der Popula- 
tion spezifizierter Individuen abgefragt wurden, betrachten wir im Folgenden 
zwei Individuen der Gesellschaft, LEA und COND . 

b) So erfahren wir aus Abbildung 4: Pl^F — s\LEA) = 1 , was bedeutet, 
dass LEA zum Zeitpunkt —1 Single war. 




Abbildung4. Wissensstand zum Zeitpunkt — 1. 



c) Weil Pl 2 {E=j | LEA) = 0, Pli(E=j | LEA) = 1 und 

P$(E=j | LEA) = 1 sind, vgl. Abbildung 4 und 5, ist das gleichbedeutend 
mit der Aussage: 

LEA ist nicht immer Mutter gewesen. 
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Abbildungö. Wissensstand zum Zeitpunkt —2. 



d) Aus P* 2 (F=s I LEA) = 1 und P* 1 (F=s | PP4) = 1 leiten wir ab: 

LEA war schon bis Zeitpunkt —1 stets Single gewesen. 

e) Aus Abbildung 5 erfahren wir, dass LEA zum Zeitpunkt —2 Single gewe- 
sen war aber noch keine Mutter. 

Es ist nämlich P* 2 (F=s | LEA) = 1 und P* 2 (E=j | LEA) = 0. Der Bild- 
schirmausdruck in Abbildung 4 informiert darüberhinaus, dass LEA in 
—1 Mutter wurde: P* 1 (P=j | LEA) = 1 . Folglich erfahren wir aus der 
Kombination der beiden Wissensstände aus der Vergangenheit: 

Bevor LEA Mutter wurde, war sie Single gewesen. 



Ohne die entsprechenden Bildschirmausdrucke zu zeigen, berichten wir darüber, 
dass 

f) Pq(F=v | COND) = 0 und P±(F=v \ COND) = 1, was gleichbedeutend 
ist mit 

COND wird (in 1) heiraten. 

g) p*( F=v | COND) = 1 und P 2 * (E=j | COND) = 1, in Worten: 

Wenn Cond Vater werden wird, wird er geheiratet haben. 

Ohne einen allzu strengen Bezug zur Grammatik menschlicher Sprache her- 
stellen zu wollen, müssen wir der vorgestellten Methode zur Bildung von 
Zeitformen jedoch eine große Aussagekraft bescheinigen. So kann man Sach- 
verhalte im Jetzt (Präsens), in der Vergangenheit (Präteritum), in der bis ins 
Jetzt reichenden Vergangenheit (Perfekt) und schließlich auch in Bezug vor- 
und nachgelagerter Vergangenheitszeitformen (Plusquamperfekt) darstellen. 
Ähnliches gilt für zukünftige (Futur I) und relativ zukünftige Sachverhalte 
(Futur II). Der Leser mag anhand der Beispiele a) bis g) diese Aussagen 
überprüfen. 
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5 Fazit 

In diesem Beitrag wurde gezeigt, wie der axiomatisch fundierte Max-Ent- 
Inferenzprozess um temporale Aspekte ergänzt werden kann. Während in der 
klassischen temporalen Logik neben den Konnektiven “und“ , “oder“ sowie 
“nicht“ zum Ausdruck temporaler Sachzusammenhänge auf weitere Konnek- 
tive wie “immer“ , “bevor“ etc. zurückgegriffen werden muss, geschieht die 
temporale Erweiterung in dem hier vorgestellten Ansatz über die Verwendung 
von Zeitkonditionalen. Damit ist es möglich, auf Basis des informationstreu- 
en Max-Ent-Prinzips über einen zeitlichen Modellhorizont hinweg Wissen, 
das bis zu einem bestimmten Zeitpunkt erworben wurde oder wird, jederzeit 
abzurufen. Auf diese Weise gestattet die Verwendung von Zeitkonditionalen 
auch die Formulierung von Sachzusammenhängen in verschiedenen Zeitfor- 
men, wie sie in der Alltagssprache verwendet werden, was die Mächtigkeit 
des konditionalen Zeitformenmodells eindrucksvoll unterstreicht. 
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Zusammenfassung Die im vorliegenden Beitrag angestellten Überlegungen kon- 
zentrieren sich auf die Entwicklung eines unscharfen regelbasierten Systems zur 
automatisierten Bewertung von Dienstplänen. Als Inputgrößen des Systems model- 
lieren wir die linguistischen Variablen Personalbedarfsdeckung und Mitarbeiterzu- 
friedenheit mit ihren korrespondierenden linguistischen Termen. Die resultierende 
Outputgröße ist die Gesamtbewertung des Dienstplanes. Ein weiteres Augenmerk 
gilt neben der Modellierung des unscharfen Regelsystems der Lösung des in diesem 
Zusammenhang stehenden Skalierungsproblems. 



1 Einleitung 

In der Praxis der Dienstplanung wird vielfach die Forderung nach der Gene- 
rierung guter Dienstpläne laut. Als gut werden solche Dienstpläne bezeich- 
net, die zum einen einen Beitrag zur Erfüllung der Unternehmensziele leisten 
und zum anderen auf Akzeptanz der betroffenen Mitarbeiter stoßen (vgl. 
[6], [11]). Sie führen u. a. zu möglichst geringen Abweichungen vom Perso- 
nalbedarf (Perspektive des Unternehmens) und sehen z. B. - wenn möglich 
- die Gewährung geblockter freier Tage vor (Perspektive der Mitarbeiter). 
Da die zu erfüllenden Kriterien meist in unscharfer Form vorliegen und die- 
se Unschärfe mit traditionellen Verfahren nicht adäquat verarbeitet werden 
kann, bietet es sich an, auf Fuzzy-Konzepte (insb. auf Verfahren des Fuzzy- 
Control) zurückzugreifen (vgl. [1], [4], [7]). Darüber hinaus ist zu beachten, 
dass die verwendeten Input- und Outputgrößen hinsichtlich ihrer Bewertung 
in hohem Maße durch Subjektivismen geprägt sind. Dies zeigt sich beispiels- 
weise in der unterschiedlichen Wahrnehmung und Beurteilung von Schicht- 
mustern, aber auch bei der Evaluation von Personalbedarfsabweichungen. 
Dienstpläne werden i. d. R. von einer einzelnen Person, dem sog. Dienstpla- 
ner erstellt. Seine Aufgabe ist es, nach eigenem Ermessen gute Dienstpläne 
zu erstellen und zwar unter Berücksichtigung der Perspektive des Unterneh- 
mens und der Perspektive der Mitarbeiter: Dies impliziert letztendlich, dass 
die Bewertung von subjektiven Einschätzungen des Dienstplaners abhängt, 
der mitunter jedoch die Präferenzen der Mitarbeiter antizipiert. 

Da bereits bei relativ einfachen Problemstellungen eine Vielzahl theore- 
tisch möglicher und zulässiger Dienstpläne existiert, ist eine systematisch- 
methodische sowie automatisierte Generierung und Evaluierung von Dienst- 
plänen erforderlich (vgl. [8], [10], [11]). Im folgenden präsentieren wir ein Mo- 
dell, welches die subjektiven Vorstellungen des Dienstplaners hinsichtlich der 
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Güte von Personalbedarfsdeckungen und der Güte von Schichtmustern formal 
abbildet und diese im Rahmen eines unscharfen regelbasierten Systems ver- 
arbeitet. Als Ergebnis erhalten wir die Gesamt bewert ung von Dienstplänen 
aus Unternehmens- und Mitarbeitersicht. 

2 Modellannahmen 

Bei dem zu konstruierenden Modell handelt es sich um einen bewusst einfach 
gehaltenen Ansatz zur Bewertung von Dienstplänen. Das Modell beruht auf 
den nachfolgend aufgeführten Annahmen: 

• Wir betrachten aus dem Kanon der Dienstplanungsansätze ein Days-Off- 
Planungsproblem, d. h. wir bewerten Dienstpläne bei denen Mitarbeitern 
arbeitsfreie Tage und Arbeitstage zugeordnet werden (vgl. [8], [10]). Der 
Planungszeitraum beträgt eine Woche, wobei wir die Tage mit t=Mo., 
Di., ..., So. bezeichnen. 

• Ziel des Unternehmens ist es, den Personalbedarf möglichst exakt zu 
decken. Folglich sind Personalbedarfsunterdeckungen und -Überdeckun- 
gen zulässig. Ein Dienstplan erfährt jedoch eine um so schlechtere 
Bewertung, je größer die Differenz zwischen Ausstattung und Bedarf 
ausfällt. Wir bewerten hierbei das arithmetische Mittel aller Abweichun- 
gen einer Woche, wobei zur Berechnung der Abweichungen die Formel 
J — -pß - t — - berücksichtigt wird. Dies impliziert, dass wir Personalbedarfs- 
unterdeckungen und -Überdeckungen als gleichwertig einstufen, die Ab- 
weichungsbewertung jedoch von der absoluten Höhe des Personalbedarfs 
abhängt. In Tabelle 2.2 ist exemplarisch ein Dienstplan dargestellt. Die 
relativen täglichen Personalbedarfsabweichungen finden sich in der letz- 
ten Zeile, die aggregierte Abweichung beträgt 0,079. Diese Größe gilt es, 
im Rahmen des sich in Kapitel 3 anschließenden Modells zu bewerten. 

• Das Unternehmen bietet den Arbeitskräften ausschließlich Schichtmuster 
des Typs 5+2 an (5 Arbeitstage und 2 freie Tage). Bei den Schichtmustern 
unterscheiden wir zum einen, ob konsekutive oder nicht konsekutive freie 
Tage gewährt werden und zum anderen, welche Tage (Wochentag oder 
Wochenende) als freie Tage vorgesehen sind. Nach dieser Differenzierung 
erhalten wir fünf Schichtgrundmuster (G$) (s. Table 1). 

• Jede Arbeitskraft kann prinzipiell in jeder Schicht bzw. an jedem Tag zur 
Personalbedarfsdeckung herangezogen werden. Darüber hinaus verbin- 
den Arbeitskräfte mit den oben angegebenen Schichtgrundmustertypen 
unterschiedliche Nutzenwerte U(G$). Wir berücksichtigen hierbei die Nut- 
zenwerte eines repräsentativen Durchschnittsmitarbeiters (s. Table 1). 

• Der Nutzen bzw. die Zufriedenheit der Mitarbeiter mit einem Dienst- 
plan hängt von dem jeweils zugeteilten Schichtmuster ab. Dabei gehen 
wir davon aus, dass der Mitarbeiter bei der Beurteilung des Dienstplanes 
nur den Dienstplan an sich und nicht das ihm zugewiesene Schichtmuster 
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Tabellel. aktive Regeln 



konsekutiv nicht konsekutiv 

Wochenende Wochenendtag/ Wochentag Wochentag/ Wochentage 

Wochentag Wochenendtag 

Gi G 2 Gs G 4 G 5 

U(Gi)=6 U(G 2 )=5,1 U(G 3 )=4,4 U(G 4 )=2 U(G 5 )=0,7 



Tabelle2. Dienstplan 



t 


Mo. 


Di. 


Mi. 


Do. 


Fr. 


Sa. 


So. 


u (Gi) 


PBt 


17 


12 


15 


21 


14 


16 


8 






6 


- 


- 


6 


6 


6 


6 


4,4 




2 


2 


2 


- 


- 


2 


2 


4,4 




3 


3 


3 


3 


- 


- 


3 


5,1 




2 


2 


2 


2 


2 


- 


- 


6 




- 


4 


4 


4 


4 


4 


- 


5,1 




2 


- 


2 


2 


2 


2 


- 


2 




2 


2 


2 


2 


- 


2 


- 


2 


PA t 


17 


13 


15 


19 


14 


16 


11 




\PA t -PB t \ 

PB t 


0 


0,083 


0 


0,095 


0 


0 


0,375 





kennt. Er ist jedoch in der Lage, sich über den Erhalt eines Schichtmusters 
ein Wahrscheinlichkeitsurteil zu bilden. Als Kalkül für die Präferenz fun- 
giert der Erwartungswert des Nutzens eines Dienstplanes (EU(G)); die- 
ser resultiert aus der Wahrscheinlichkeit des Erhalts eines Schichtmusters 
vom Grundtyp i ( Pi ) multipliziert mit dem Nutzen eines Schichtmusters 
vom Grundtyp i (U(G*)) summiert über alle i. Formal dargestellt gilt der 
folgende Zusammenhang (vgl. [3]): 

5 

EU(G) = Y,Pi * U{Gi) (1) 

i= 1 

Für den in Table 2 dargestellten Dienstplan, ergibt sich gemäß der oben 
aufgeführten Formel für den Erwart ungswert des Nutzens ein Wert in 
Höhe von 4,33. Diesen bewerten wir im nachfolgenden Modell, indem 
wir Zugehörigkeitswerte zur Menge der sehr guten bis sehr schlechten 
Dienstpläne zuordnen. 

• Die Gesamtbewertung eines Dienstplanes hängt von der Güte der Perso- 
nalbedarfsdeckung und von der Güte der Schichtmuster ab (vgl. [11]). 
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3 Mo dellfor mulier ung 

3.1 Modellierung der linguistischen Variablen 

Im ersten Schritt wollen wir uns nun der Bewertung der aggregierten re- 
lativen Abweichungen vom Personalbedarf widmen. Dazu modellieren wir 
für die linguistische (Input-) Variable Personalbedarfsdeckung fünf linguisti- 
sche Terme (sehr gute, gute, mittlere, schlechte und sehr schlechte Perso- 
nalbedarfsdeckung) und bilden diese auf der Grundmenge der aggregierten 
relativen Abweichungen vom Personalbedarf ab. Die subjektiv festgelegten 
Zugehörigkeitsfunktionen der linguistischen Terme zeigt Fig. 1 (vgl. [12]). 



Zugehörig- 

keitsgrad 




0 0,079 0,1 



♦—sehr gut (SG) 
-■-gut (G) 

-A- mittel (M) 

■■ schlecht (S) 
-■-sehr schlecht (SS) 

aggregierte relative 
1 Personalbedarfsabwei- 
0,6 chungen 



Abbildungl. linguistische Variable Personalbedarfsdeckung (PB) 



Die Bewertung der Personalbedarfsdeckung im obigen Beispiel erfolgt 
nunmehr in fuzzyfizierter Form. Mit einem Zugehörigkeitswert von 0,3 gehört 
die Abweichung von 0,079 zur Menge der guten Personalbedarfsdeckungen 
und mit einem Zugehörigkeitswert von 0,42 zur Menge der sehr guten Perso- 
nalbedarfsdeckungen. Diese Ergebnisse sind auch aus Fig. 1 ablesbar. 

Die linguistische (Input-) Variable Mitarbeiterzufriedenheit charakterisie- 
ren wir ebenfalls anhand fünf linguistischer Terme (sehr hoch, hoch, mittel, 
niedrig, sehr niedrig) und bilden diese auf der Grundmenge Erwartungsnutzen 
ab. Für die scharfe Inputgröße des obigen Beispiels in Höhe von 4,33 erhalten 
wir einen Zugehörigkeitswert von 0,07 zum linguistischen Term mittlere Zu- 
friedenheit und mit 0,8 zum linguistischen Term hohe Zufriedenheit (s. Fig. 
2 )- 

Als letzte Größe verbleibt nun die Modellierung der linguistischen (Out- 
put-Variable Gesamtbewertung Dienstplan. Wir charakterisieren diese an- 
hand fünf linguistischer Terme, die wiederum mit sehr gut, gut, mittel, 
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Zugehörig- 

keitsgrad 




Abbildung2. linguistische Variable Mitarbeiterzufriedenheit (MZ) 



Zugehörig* 

keitsgrad 



1,2 - - 
1 ■■ 
0 , 8 - 
0 , 6 - 
0 , 4 - 
0 , 2 - 
0 — 



—♦—sehr gut 
— *-gut 
—•—mittel 
—•—schlecht 
— *— sehr schlecht 



Dienstplan- 

bewertung 



Abbildung3. linguistische Variable Gesamtbewertung Dienstplan (D) 



schlecht und sehr schlecht bezeichnet werden. Im Gegensatz zu den beiden lin- 
guistischen Variablen Personalbedarfsdeckung und Mitarbeiterzufriedenheit, 
liegt uns jetzt eine ordinal skalierte Grundmenge in Form einer Notenskala 
von 1 bis 5 vor (beste Note = 1, schlechteste Note = 5). Für die Modellierung 
hat dies zur Konsequenz, dass wir die linguistischen Terme nur in Form von 
Singletons abbilden können (s. Fig. 3). 

3.2 Formulierung der zugrundegelegten Regelbasis und 
Ermittlung der resultierenden Outputmenge 

Die Verknüpfung der linguistischen In- und Outputgrößen realisieren wir über 
eine Regelbasis, die (hier) aus 25 Regeln besteht und sich aus der Kombi- 
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nation aller linguistischen Terme der linguistischen Variable Mitarbeiterzu- 
friedenheit (MZ) mit den linguistischen Termen der linguistischen Variable 
Personalbedarfsdeckung (PB) ergibt. Die mit den jeweiligen Regeln korre- 
spondierenden Schlussfolgerungen hegen im Ermessen des Dienst planers: Er 
entscheidet bei Vorliegen bestimmter Prämissen aus seiner Erfahrung heraus 
über die Einstufung eines Dienstplanes. In Table 3 sind exemplarisch vier 
Regeln dargestellt. 



Tabelle3. aktive Regeln 



r 3 


WENN 


PB SG und MZ M 


DANN 


D G 


R4 


WENN 


PB SG und MZ H 


DANN 


D SG 


R8 


WENN 


PB G und MZ M 


DANN 


D G 


R 9 


WENN 


PB G und MZ H 


DANN 


D G 



Die weitere Vorgehensweise beschreiben wir wiederum unter Bezugnah- 
me auf das in Kapitel 2 eingeführte Beispiel. Die dort ermittelten scharfen 
Input- Werte hegen bereits in fuzzyfizierter Form vor. Der nächste Schritt der 
Inferenz besteht nun darin, die aktiven Regeln zu identifizieren, wobei eine 
Regel dann aktiv ist, wenn deren sämtliche Prämissen erfüllt sind (z. B. Zu- 
gehörigkeit zur Menge der PB SG und Zugehörigkeit zur Menge MZ M > 
0). Bezogen auf unser bisheriges Beispiel, existieren dann vier aktive Regeln 
(#3, #4, Rg und Rg) und zwar diejenigen, die zu den Prämissen PB = sehr 
gut und MZ = hoch, PB = sehr gut und MZ = mittel, PB = gut und MZ = 
hoch sowie PB = gut und MZ = mittel gehören (s. Table 3). 

Zur Ermittlung der einzelnen Output- Fuzzy- Mengen müssen wir zunächst 
die Erfüllungsgrade (Hi) der aktiven Regeln ermitteln. Da die Prämissen der 
Regeln UND-verknüpft sind, wählen wir zur Verknüpfung der Zugehörig- 
keitswerte aus der Gruppe der t-Normen den Minimumoperator (vgl. [1], [2], 
[7]). Als Ergebnis erhalten wir für unsere aktiven Regeln: 773=0,07, #4=0,42, 
#8=0507, #9=0,3, wobei sich z. B. #3 aus der Operation Min( 0, 42; 0, 07) = 
0, 07 ergibt. 

Die zu gleichen Konsequenzen führenden Regeln (im vorliegenden Beispiel 
#3, Rg und Rg) überlagern wir dann mit dem Maximumoperator, kappen 
die Fuzzy- Mengen der Schlussfolgerung jeder aktiven Regel in der Höhe des 
jeweiligen Erfüllungsgrades und tragen diese auf der Outputgröße Gesamtbe- 
wertung Dienstplan ab. Durch Überlagerung der einzelnen Fuzzy- Mengen mit 
dem Maximumoperator erhalten wir die in Fig. 4 dargestellte resultierende 
Output-Fuzzy- Menge (vgl. [4], [5], [7], [9]). Diese beinhaltet die Bewertung 
des vorliegenden Dienstplanes als sehr gut mit dem Zugehör igkeitswert 0,42 
und als gut mit dem Zugehörigkeit swert 0,3. 
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Zugehörig- 

keitsgrad 




3.3 Defuzzyfizierung der unscharfen Output menge 

Der letzte Schritt unseres Modellansatzes besteht nun darin, eine konkrete 
Handlungsempfehlung bzw. eine abschließende Bewertung des Dienstplanes 
vorzunehmen (vgl. zu Defuzzyfizierungsverfahren [4], [5]). Da die linguisti- 
schen Terme unserer Outputvariable in Form von Singletons dargestellt wer- 
den, ist unseres Erachtens die Maximummethode, wonach die Regel mit dem 
höchsten Erfüllungsgrad ( R 4 ) den Ausschlag bei der Bewertung gibt, das ge- 
eignetste Verfahren. Der im vorliegenden Beispiel verwendete Dienstplan ist 
demnach in die Kategorie der sehr guten Pläne einzuordnen. 

4 Schlussbemerkungen 

Der vorliegende Beitrag erläutert die Konzeption eines Modells zur Bewer- 
tung von Dienstplänen auf Basis unscharfer regelbasierter Systeme. Als In- 
putgrößen dieses Modells dienen die linguistische Variable Personalbedarfs- 
deckung und die linguistische Variable Mitarbeiterzufriedenheit. Die Output- 
größe stellt die linguistische Variable Gesamtbewertung Dienstplan dar. Be- 
sonderes Charakteristikum des Modells ist das unterschiedliche Skalenniveau 
der In- und Outputgrößen. Während die Inputgrößen auf einer metrischen 
Skala gemessen werden, weist die Outputgröße eine ordinale Skalierung auf. 
Im Rahmen der Modellformulierung zeigen wir, wie sowohl ordinale als auch 
metrisch skalierte Größen in unscharfen regelbasierten Systemen formal dar- 
gestellt und verarbeitet werden können. 

Zukünftige Forschungsarbeiten werden sich mit der Erweiterung dieses 
Modellansatzes zu beschäftigen haben. Dabei wird es vor allem um die Erwei- 
terung und Modifikation der Modellannahmen gehen. Mitunter sollen weitere 
Schichtmustertypen integriert, die Bewertung der Personalbedarfsabweichun- 
gen modifiziert und weitere Arbeitskräftekategorien berücksichtigt werden. 
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Abstract. Evolutionary Algorithms (EA) are excellent optimization tools for com- 
plex high-dimensional multimodal problems. However, they require a very large 
number of problem function evaluations. In many engineering optimization prob- 
lems, like high throughput material science or design optimization, a single fitness 
evaluation is very expensive or time consuming. Therefore, standard evolutionary 
computation methods are not practical for such applications. Applying models as 
a surrogate of the real fitness function is a quite popular approach to handle this 
restriction. We propose a Model Assisted Evolution Strategy (MAES), which uses a 
Gaussian Process (GP) approximation model. The purpose of the Gaussian Process 
model is to preselect the most promising solutions, which are then actually evalu- 
ated by the real problem function. To refine the preselection process the likelihood 
of each individual to improve the overall best found solution is determined. Nu- 
merical results from extensive simulations on high dimensional test functions and 
one material optimization problem are presented. MAES has a much better con- 
vergence rate and achieves better results than standard evolutionary optimization 
approaches with less fitness evaluations. 



1 Introduction 

Evolution Strategies (ES) are one class of Evolutionary Algorithms (EAs) 
which are often used as optimization tools for complex high dimensional mul- 
timodal problems [8] [9]. In contrast to other EAs like Genetic Algorithms 
or Genetic Programming ES work directly on real valued objective variables, 
which represent a possible solution. Therefore ES are very suitably for many 
engineering optimization problems. 

However, like other population based EAs ES require a very high number of 
fitness function evaluations to determine an acceptable solution. In most real 
world engineering optimization applications the process of fitness evaluation 
is very expensive and time consuming. Therefore standard ES methods are 
not practical for such applications. 

A promising approach to handle this problem is the application of modeling 
techniques, where a model evaluation is orders of magnitude cheaper than 
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a real fitness function evaluation. A model is trained on already evaluated 
fitness cases and is used to guide the search for promising solutions. This 
approach decreases the number of expensive fitness evaluations and has a 
better convergence rate. The application of modeling techniques in evolu- 
tionary computation receives increasing attention [7] [2] [3] [10]. A survey on 
this research field can be found in [6]. 

The remainder of this paper is organized as follows: Section 2 introduces the 
synthesis of the Gaussian Process (GP) fitness approximation model with 
a standard ES. The GP model is utilized to assist the ES by selecting the 
most promising solutions of an offspring population to be evaluated by the 
real fitness function. Numerical results from extensive simulations on high 
dimensional artificial test functions and one material optimization task are 
presented and discussed in section 3. The paper closes with a brief conclusion 
and outlook on future work. 



2 GP Model Assisted Evolution Strategy 

For the approximation of the fitness function we chose Gaussian Processes 
(GP), which are general and proper real valued function approximators, espe- 
cially for noisy training data. A detailed description is given in [4]. Compared 
to other models like artificial neural networks GP are probabilistic models, 
which have the advantage of providing a confidence value given by the stan- 
dard deviation <j for the predicted fitness value t without additional com- 
putational cost. Moreover GP are stable against overfitting and have only a 
limited number of model parameters, which have to be chosen by the user. 
[9]. We start our consideration with a standard (//, A) ES, which will be later 
coupled with the GP model. An ES works on a population of potential so- 
lutions x (individuals) by manipulating these individuals with evolutionary 
operators [8] . By applying the evolutionary operators reproduction, recombi- 
nation and mutation (see pseudocode in Figure 1) A offspring individuals are 
generated from (i parents. After evaluating the fitness of the A offspring in- 
dividuals, fx individuals with the best fitness are selected by a (//, A) strategy 
to build the parent population for the next generation. The algorithm ter- 
minates when a maximum number of fitness function evaluations have been 
performed. 

To incorporate the approximation model into the ES we use a pre-selection 
concept similar to the one described by Emmerich et al. [3] . Compared to the 
standard ES Xp re > A new offspring individuals are created from \x parents 
(see pseudocode in Figure 2). These \p re individuals have to be pre-selected 
to generate the offspring of A individuals, which will be evaluated with the 
real fitness function. The model is trained at the beginning with a randomly 
created initial population and is updated after each generation step with A 
new fitness cases. The key point of our approach is the pre-selection proce- 
dure. Using the mean of the model prediction to identify the most promising 
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Procedure ES 
Begin 
eval=0 ; 

Pop=CreateInitialPop() ; 

Pop . EvaluateRealF itness ( ) ; 

while (evaKmaxeval) ; 

Of fspring=Pop. Reproduce (A) ; 

Off spring. Mutate () ; 

Offspring . EvaluateRealFitness () ; 

Pop=0ff spring. SelectBest (/x) ; 
eval=eval+A ; 
end while 
End 



Procedure MAES 
Begin 
eval=0 ; 

Pop=CreateInitialPop() ; 

Pop. EvaluateRealFitness () ; 

Model . update (Pop) ; 
while (evaKmaxeval) ; 

PrePop=Pop . Reproduce (A p re ) ; 
PrePop . Mutate () ; 

PrePop . EvaluateWithModel ( ) ; 

Off spring=PrePop.SelectBest (A) ; 
Off spring. EvaluateRealFitness () ; 
Model. update (Off spring) ; 

Pop=0ff spring . SelectBest (/i) ; 
eval=eval+A ; 
end while 
End 



Fig. 1. Standard (//, A) Evolution Strategy Fig. 2. Model Assisted Evolution Strategy 
(ES). (MAES). 



individuals leads to premature and suboptimal convergence rate on multi- 
modal problems with many misleading local minima, because individuals 
with a better model prediction are preferred to others and therefore have a 
lower probability to escape from these minima. 




Fig. 3. The gray filled area represents 
the probability that a model output 
value t is sampled at point x*, which 
is smaller than f m %n (POI). 




Fig. 4. Areas with a higher POI crite- 
rion have a higher probability to sam- 
ple a data point with a target value 
smaller than fmin- 



To address this problem we use a new pre-selection criterion, which utilizes 
the model confidence given by the GP model as the standard deviation a{x). 
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The idea is not new in the field of global optimization [1], but new in the 
context of evolutionary optimization. The concept is illustrated in Figure 
3. At any given point x , we model the uncertainty about the model value 
prediction by considering this value to be like the realization of a random 
variable Y(x) with mean t(x) and standard deviation cr(x). 

Let fmin = ram(ti, tw) be the current best fitness value sampled until now, 
then the target value for the improvement will be some number T < f m %n • The 
Probability Of Improvement (POI) is simply the probability that Y (x) < T. 
Assuming the random variable is normal distributed, this probability is given 

p ° '<*> = * (^) (i > 

where #(•) is the normal cumulative distribution function. Figure 4 shows the 
characteristics of the POI selection criterion. Areas with a high POI have a 
high probability to sample a data point with a target value smaller than f m in 
and are therefore more promising. Areas with model prediction t(x) » fmin 
have a low probability of improvement POI « 0. As the function is sampled 
more and more around the current best point, the standard deviation in this 

area decreases. The term becomes extremely negative and POI will 

be so small that the algorithm is driven to search elsewhere in unexplored 
areas where the standard deviation is higher. Therefore POI prefers unex- 
plored areas of object space and has a multimodal characteristic. Note, that 
the maximal POI value may have another location in object space than the 
minimal model output value. The individuals Xi,i = 1, .., \p re with the high- 
est POI{x) are pre-selected to build the new offspring. 

The size of the pre-selected population \p re controls the impact of the 
model on the evolutionary optimization process. For Xp re = A, the algorithm 
performs like a standard (/i, A) ES. Increasing \p re results in a larger selection 
pressure in the pre-selection and in a stronger impact of the model on the 
convergence behavior of the optimization process. 



3 Experimental Results and Discussion 

To analyze the algorithms extensive numerical simulations were performed 
for 5 artificial test functions and one material optimization problem. For each 
case the standard (//, A)-ES algorithm is compared with the new (//, A)-MAES 
algorithm for population size (fi = 5, A = 35). 

The size of the pre-selected population A p re was set to 3A. We used Co- 
variance Matrix Adaption (CMA) developed by Hansen et al.[5], which is a 
powerful method for adaption of the mutation step size. For all simulations 
no recombination was used and the initial population size was set to 10. 
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The training data for the GP model consisted of the 2A most recently per- 
formed fitness evaluations. For this reason the model is a local model of the 
individual’s neighborhood in object space. Using more training data improves 
the performance only slightly but results in with much higher computational 
costs for model training. 

The values are always evaluated as the mean of 100 repeated runs with dif- 
ferent seed values for random number generation. 

The Sphere function f sphered ) = x \ is a nonlinear and unimodal test 
function which is a good test for the self- adaptation mechanism of ES. 

The MAES (see Figure 5) shows a better convergence rate and outperforms 
the standard ES clearly. It reaches 10 times better fitness values after 5000 
evaluations. Comparable results are obtained with several other unimodal 
functions. In Figure 6 results are presented for the Schwefel 1.2 test function: 

f Schwefelipc) = X^=l (^2j=l x j^ • 

The Rosenbrock function (2) is nonlinear, continuous and not symmetric. 




Fig. 5. 20-dim. Sphere function: fitness 
of best individual. 




Fig. 6. 20-dim. Schwefels’s function 
1.2: fitness of best individual. 



20 

f Rosenipt) ~ ]T(100 ■(% 1 -i i f + (x,-l) 2 ) (2) 

i = 1 

It is a very popular test function and has a very hard to find global optimum. 
Figure 7 shows that MAES reaches better fitness values than the standard 
ES. These results justifies the motivation of the model assisted approach to 
support the algorithm by identifying the most promising individuals. 
Multimodal functions evoke hills and valleys, which are misleading local op- 
tima. A simple optimization algorithm like hill-climbing would get stuck in 
a local minimum. For such problems evolutionary algorithms are much more 
appropriate. 
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Ackley’s test function (3) is symmetric and very bumpy. 



fAck(x) = 20 + e — 20 exp —0.2 ■ 



\ 



i A \ /if 

2Ö ' 2^ X i - eX P I )^ COS ( 27rX i 
i= 1 J \ i— 1 



(3) 

Its number of local minima increases exponentially with the problem dimen- 
sion and has a global optimum with very strong local features. Here MAES 
converges faster than the standard ES (see Figure 8) . Comparable results are 
obtained for Rastrigin’s test function (3) (see Figure 9). 



20 

fRast (*) = 10 • 20 + - cos (27ra?j)) (4) 

i = 1 





Fig. 7. 20-dim. Rosenbrock function: Fig. 8. 20-dim. Ackley’s function: fit- 
fitness of best individual. ness of best individual. 



The last presented result shows the application of the new MAES algo- 
rithm on a real world engineering optimization. Here the task is to optimize 
certain chemical catalytic properties of solid state samples created by a high 
throughput process. The objective function of the problem is modeled by a 
artificial neural network with data from already performed experiments and 
depends on 6 input variables, which describe the synthesis of the samples. 
The MAES algorithm outperforms the standard ES (see Figure 10). From the 
beginning MAES has a higher convergence rate and yields better solutions. 
It clearly yields better solutions with less fitness function evaluations. For 
example MAES reaches 2 times better solutions after 400 evaluations than 
the standard ES. Therefore MAES halves the costs of optimization for this 
application. 




441 





Fig. 9. 20-dim. Rastrigin’s function: Fig. 10. 6-dim. Material optimization: 

fitness of best individual. fitness of best individual. 



4 Conclusions 

We applied a Gaussian Process as an approximation model to assist a stan- 
dard ES by using the GP to pre-select the most promising individuals to be 
evaluated by the real fitness function. 

The pre-selection procedure is given by the Probability Of Improvement 
(POI) pre-selection criterion. POI addresses the tradeoff between exploita- 
tion and exploration by utilizing the probabilistic interpretation of the GP 
model. This is done by evaluating the likelihood of each individual to improve 
the overall best solution. 

Extensive simulations on artificial test functions showed that this approach 
enhances the performance of a standard ES on unimodal and multimodal 
problems. MAES has a higher convergence speed and is much more stable 
against premature convergence for multimodal problems. This is reasonable, 
because the MAES with POI pre-selection criterion has a higher tendency to 
sample in unexplored areas. 

For a material optimization problem MAES yields the same solution qual- 
ity with half the function evaluations and achieves overall better solutions. 
Therefore the application of MAES halves the costs compared to the stan- 
dard ES method. These encouraging results justify the application of MAES 
in the field of engineering optimization applications where problem evalua- 
tions are very costly. 

For further work it is planned to develop a mechanism which controls the im- 
pact of the approximation model on the optimization process by controlling 
A p re . This can be carried out by using the confidence of the approximation 
model. 
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Abstract. The paper aims at drawing attention to the potential of (qualitative) 
stability theory of stochastic programming for the study of asymptotic properties 
of statistical estimates. Making use of existing stability results, it is often possible 
to weaken the assumptions and to deal also with non-standard estimation prob- 
lems. Thus non-unique solutions to the underlying optimization problems as well 
as constraints for the estimates can be taken into account and the continuity as- 
sumptions can often be replaced by semicontinuity. In this paper the focus is on 
consistency for constrained estimation with non-unique solutions. It will be shown 
how stability results obtained by the author can be employed to derived assertions 
on the convergence in probability of statistical estimates. The general results use 
the epi-convergence approach. 



1 Introduction 

Roughly spoken, stochastic programming problems deal with optimization 
problems which contain random elements in the objective functions and/or 
the constraints. Often they originate from decision problems where an opti- 
mal decision has to be chosen before random variables which influence the 
outcome are completely known. Then one usually looks for decisions optimiz- 
ing some appropriate deterministic surrogate problem which usually contains 
expectations with respect to the distribution of the random variables involved 
([23], [14]). In order to solve such a problem numerically, approximations, e.g. 
via estimates for unknown parameters or integration quadratures for the in- 
tegrals, play an important role. Hence there has been a need for stability 
statements in order to judge whether solutions to the approximate problems 
come close to the solutions of the true problems. As the approximate prob- 
lems are often based on estimates, convergence statements on the optimal 
values and the solution sets have been derived in the deterministic setting 
as well as in the ‘almost surely’ and the ‘in probability’ setting (cf. [19], [10] 
and the papers quoted there) . The results apply to constrained problems and 
allow for non-unique solutions. 

Stability statements for convergence ‘in distribution’ are also available 
([21]). They are not of interest when a deterministic surrogate (decision) 
problem is approximated, but are promising when optimization problems 
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with respect to stochastic processes are investigated. They can also be em- 
ployed when so-called distribution problems (cf. [14]) are studied. 

The potential that stability theory of stochastic programming bears for 
asymptotic statistics was soon recognized ([2], [16]). Many estimators have 
proved to be solutions to random optimization problems. Consistency of these 
estimators can be investigated via convergence of solutions to the optimiza- 
tion problems. Assertions on the asymptotic distribution may be derived 
studying the ‘limit problem’ to appropriately ‘blown up’ problems. 

Of course stability theory of stochastic programming can also be employed 
to prove results on so-called value-consistency of statistical models. Value 
consistency is considered, for instance, in [1]. 

Prom the beginning, in papers which use approaches from stochastic pro- 
gramming, emphasis has been put on epi-convergence instead of uniform 
convergence of the objective functions, which is often imposed in papers on 
asymptotic statistics ([2], [12], [13], [5], [8]). Constraints have also been con- 
sidered, see [13], [4], [17] for statements about the asymptotic distribution in 
the case of constrained estimation. 

Furthermore, papers on asymptotic statistics usually assumed that cer- 
tain identifiability conditions are fulfilled, i.e. it is required that the opti- 
mization problems provide unique estimators. Meanwhile, however, also non- 
identifiable models gain growing interest from the statisticians’ side. Van der 
Vaart ([18]) presents a consistency result for M-estimators using Wald’s ap- 
proach. Ferger [3] considers convergence in distribution and proves argmax 
theorems for the non-unique case. We will show by way of example how the 
rather general qualitative stability results for stochastic optimization prob- 
lems in [19] and [21] can contribute to these investigations. 

Our starting point is a brief discussion of (qualitative) stability asser- 
tions in the deterministic setting. Consistency results, i.e. the ‘in probability’ 
setting, will be described in more detail. The explanation of corresponding 
convergence notions ‘in distribution’ requires special preliminaries and cannot 
be given here because of the restricted number of pages. Application of the 
results in [21] to asymptotic statistics is considered in [22]. Strong consistency 
is studied in [9] and illustrated by examples. 

The paper is organized as follows. In section 2 we quote van der Vaart ’s 
consistency result for non-identifiable M-estimators ([18], Theorem 5.14). In 
section 3 we sketch stability theory in the deterministic setting and introduce 
the general random optimization models we shall deal with. Section 4 consid- 
ers the ‘in probability’ version of the general stability results and shows how 
van der Vaart ’s result can be derived and extended using stability theory of 
stochastic programming. Details which have to be omitted here are given in 
[ 22 ]. 

Measurability considerations will not be discussed in this paper. We will 
sloppily assume that all measurability conditions needed are satisfied. 
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2 Consistency of M-Estimators 

The class of M-estimators is an important and widely investigated class of 
estimators which includes for instance maximum-likelihood estimators. If so- 
called identifiability conditions are not satisfied or hard to verify, the following 
consistency statement ([18]) may be used: 

Let 6 and Z be metric spaces and let {Z[)i^N be a sequence of i.i.d. ran- 
dom variables, defined on a common probability space [ß, E, P ] with values 
in Z, provided with the a - field of Borel sets <r(Z). P denotes the probability 
measure which is induced on cr(Z) by Z*. For a function m\© x Z — » R and 
n G N define 

M n {d) := £ ^2 Zi), d n := arg max, M n (d), and Mq{$) := f m(d,z)dP(z). 

i= l 

Uniqueness of $ n , n G { 0,1,...}, is not imposed. It is only assumed that 

@o := {tfo £ ©\ sup / m{d,z)dP(z) = f m(do, z)dP(z)} 

'dee 

is non-empty. 

Theorem 1. (Theorem 5.14 in [18]) 

Let the following assumptions be satisfied: 

(Al) m(-,z) is upper semicontinuous in each de© for almost all z, 

(A2) for every sufficiently small ball U C 0 the function 

sup ra($, •) is measurable and 
#eu 

f sup m(d, z)dP(z) < oo, 

#eu 

(A3) M n (d n ) > M n (d o) - op(l) for some d 0 G 0 O - 

Then for each € > 0 and for every compact set K C 0, 
lim P(d(d n , 0o ) > £ A fi n G K) = 0 . 

n — ►oo 

3 Stability of Stochastic Programming Problems 

The general approach will be outlined in the deterministic setting. After that 
the definitions for convergence notions fin probability’ will be explained. We 
restrict ourselves to random variables Z n with values in R p . The results, 
however, hold also for random variables with values in a complete separable 
metric space. 

We consider an optimization problem 

(Po,d) min f 0 (x) 

xer 0 

which is approximated by surrogate problems 

( Pn,D ) min fn(x). 

xE± n 
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{/», n e N U {0}} is a family of objective functions f n \ R p — > i? 1 and 
{r n , n€iVU{0}}is the corresponding family of closed constraint sets. 

When dealing with constraint sets and solution sets which are not single- 
valued, convergence notions for sequences of sets are needed. Kuratowski- 
Painleve-convergence has turned out to be the appropriate concept. For 
the behavior of the solution sets, however, usually one does not obtain full 
Kuratowski-Painleve-convergence. Under reasonable conditions one can only 
expect, that cluster points of the solution sets to the approximate problems 
are solutions of the limit problem. This can be described in the following 
framework: 

Let (S n ) n £N be a sequence of subsets of RP. Then the Kuratowski-Painleve- 
Limes superior and the Kuratowski-Painleve-Limes inferior are defined in the 
following way: 

i£-limsup5 n := {s G R p \3 (s n )ne;v : s n — > s and s n G S n infinitely often}, 

n— kx) 

K— liminf S n := {s G R p \3 (s n )n<Eiv — 5 - s ands n G S n Vn > no}. 

n— xx) 

If K— lim sup S n = K— liminf S n = So, 

n — >oo n 

then the Kuratowski-Painleve-Limes exists: K— lim S n = So. For this state- 

n— »cx> 

ment we will use the abbreviation S n ^> So. 

If K— lim sup S n C So, we will call the sequence ( S n ) ne jsr an inner approx- 

n— >oo 

imation to So and use the abbreviation S n K ~ l > So . If K— lim inf S n D So , 

n — >oo 

then (S n ) ne N is an outer approximation to 5o which will be abbreviated by 

c K—o v o 
O n ^ *^ 0 * 

A sequence (S n ) ne n is e.g. an inner approximation to So, if K— lim sup S n 

n— ► oo 

is empty. Hence, when using assertions on inner approximations for the in- 
vestigation of statistical estimates one has to impose additional conditions to 
ensure that there is a convergent (sub)sequence of estimates. 

For single- valued S n , nG iV U{0}, inner approximations reduce to conver- 
gence, if there is a compact set K such that S n C K Vn > no- This compact- 
ness condition is to ensure that there exists a cluster point of ( S n ) ne N • For 
outer approximations a corresponding result is valid without further condi- 
tions. Hence assertions on semiconvergence include assertions on convergence 
in the single- valued case. 

The weakest condition on the objective functions (in the absence of con- 
straints) which guarantees inner approximations is epi-convergence. In order 
to be able to deal also with constraints, often modified objective functions 
(which take the value +oo if the constraints are violated) are considered. 
Therefore we shall explain epi-convergence for objective functions which map 
into R 1 . 

The sequence ( f n )neN ) is said to be epi-convergent to fo if the sequence 
of the corresponding epigraph multifunctions converges in the Kuratowski- 
Painleve sense to the epigraph of /o- The following condition is an equivalent 
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characterization of epi-convergence: 

Vx 0 e R p : 

(El) V(x n ) n€N with x n -> x 0 : liminf f n (x n ) > fo(xo), 

n—+oo 

A (E2) 3 (x n )n€N with x n —> x 0 : limsup f n (x n ) < fo(x 0 ). 

n— >oo 

It should be mentioned that epi-convergence of the original objective func- 
tions together with Kuratowski-Painleve-convergence of the constraint sets 
does not imply epi-convergence of the modified objective functions. Therefore 
results on simultaneous approximation of objective functions and constraint 
sets usually have to impose stronger convergence conditions on the original 
objective functions, in general continuous convergence. 

One can ’divide’ epi-convergence in the ’upper part’ (E2), called epi- upper 
approximation, and the (more restrictive) ’lower’ part (El), called lower semi- 
continuous approximation. The denomination ’lower semicontinuous’ approx- 
imation was chosen, because this is also the ’lower part’ of continuous con- 
vergence. All types of convergence under consideration can be restricted to 
a ’convergence region’ X, which is supposed to be closed. Such a restriction 
comes into play, because convergence is needed on the constraint set of the 
limit problem only. We will for instance speak of a lower semicontinuous ap- 
proximation at X (abbreviated if 

Vx 0 e X V(x n ) neN with x n > xq : liminf f n {x n ) > fo(x 0 ). 

n—> oo 

A sequence of functions ( f n )neN which is a lower semicontinuous approx- 
imation to /o at X and for which (—f n )neN is a lower semicontinuos ap- 
proximation to -/o at X is continuously convergent to fo at X (abbreviated 

fnj? fo)- 

A pointwise convergent sequence of functions is an epi-upper approxi- 
mation. Verification of lower semicontinuous approximations, however, often 
requires considerable effort. Hence sufficient conditions for this type of con- 
vergence are of special interest, see for instance [11]. 

The following theorem is a condensed version of stability results for the 
deterministic setting, see e.g. [19] for references and proofs in the almost 
surely setting. 

Let r n denote the constraint set, @ n the optimal value and \P n the solution 
set to the problem (P n ,£>), n € N U {0}. 

Theorem 2. (i) If f n f-> f Q , r 0 , and 
3 K e C p 3n 0 G N Vn > n 0 : r n C K, 
then <Pfr> $o. 

(ii) Iffnjtf fo and r n ^> r 0 , then %. 

Here C p denotes the family of nonempty compact subsets of R p . 

Of course corresponding results hold for the ’almost surely’ case. The ‘in 
probability’ setting was studied in [19]. Semi-convergence in distribution of 
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optimal values and solution sets is the topic of [21]. Roughly spoken, stability 
results corresponding to the above theorem are available in these convergence 
modes. It has to be clarified, however, how appropriate convergence notions 
‘in probability’ and ‘in distribution’ may be described. We will confine here 
to the ‘in probability’ setting. 

The above theorem is not the weakest form. One could also take into ac- 
count £ n -optimal solutions and weaken the convergence condition in assertion 
(ii), see [22] for convergence in probability and in distribution and [9] for the 
‘almost surely’ case. 

4 Convergence in Probability 

Now we turn to random optimization problems. In consistency investigations 
one usually has to deal with a deterministic limit problem. Stability results, 
however, are available also for random limit problems. Therefore we shall give 
the definitions for the general case. The advantage of having a deterministic 
limit problem can be exploited when looking for sufficient conditions for the 
convergence notions. 

In the following we will assume that a random optimization problem 
(P 0 ) min /o(a:,w) 

x€ro(u>) 

is approximated by a sequence of random surrogate problems 

(P„) min f n (x,u>). 

xer n (uj) 

Here [12, i7, P] is supposed to be a complete probability space, 
r n \Q — > 2 rp is a closed- valued measurable multifunction (which will also be 
called random closed set) and f n \R p x Q — > R 1 is a random function which 
is measurable with respect to B p <g) E (B p denotes the cr-field of Borel sets of 
R p .) 

M-estimators fit into this framework with 

n 

fo(x,uj) = fo,D(x) = - f m(x, z)dP(z) and f n (x,co) = m(x,Zi(w)). 

i = 1 

In the following we shall give the main definitions needed to prove stability 
results ‘in probability’. Details can be found in [19] and [10]. The definitions 
are based on investigations by Salinetti and Wets [15]. 

Let {G n , n G No} be a family of random sets. (G n ) n ^N is called an inner 
approximation in probability to Go (abbreviated G n Go) if 

\fe>0 WK eC p : lim P([G n \ U e G 0 ] n K ^ 0) = 0. 

n— >oo 

(G n ) n £N is called an outer approximation in probability to Go (abbreviated 
G n K-o-prob, Go ) if V£ > 0 \/K G CP : lim P([G 0 \ U e G n 1 D K ± 0) = 0. 

n—+oo 

(Gn) is Kuratowski-Painleve-convergent in probability to Go (abbrevi- 
ated G n K-P rob > (2 0 ) if it i s an inner and an outer approximation. 
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For a family {/ n , n <G No} of random functions and a closed subset 
X of R p we say that ( f n )neN is a lower semicontinuous approximation in 
probability to /o at X (abbreviated f n -~x° b> /o) if 
V£>0V^gC^ +1 : 

lim P{u : (Epi/ n (-,o;) fl [UiX x #]) 

n— *oo,l — ►oo 1 

\ U £ (Epif 0 (;w) n[XxR}) n K^Q)} = 0. 

Here U±X denotes the set {y e R p \ inf ||x — y\\ < j}. 

An upper semicontinuous approximation can then be defined claiming that 
(—fn)neN is a lower semicontinuous approximation for — /o- 

A stability theorem fin probability’ can be proved ([19]) which has the 
form of the above quoted stability theorem for the deterministic case with 
all convergence assumptions understood fin probability’ and a compactness 
condition of the form 3K e C p V K e C p : lim P(T n nkcK) = l. 

n— ► oo 

It is, however, to be mentioned that continuity of /o(-,u;) has to be im- 
posed. This additional assumption results from general relations between 
convergence almost surely and convergence in probability in our framework. 

If one deals with unconstrained problems, continuity and continuous con- 
vergence can be replaced with lower semicontinuity and epi-convergence. 

£ n -optimal solutions are not considered in [19]. The quoted stability state- 
ments can, however, also be applied to this case, making use of the following 
lemma, which is proved in [22]. 

Lemma 1. Let ( s n ) n eN , s n \ R p x Q — ► R] j_, be a sequence of random func- 
tions such that 

sup e n (x, 0 for a suitable k > 0. 

xEU k I o 

Then for ( f n )neN and a sequence ( g n )neN with g n := f n + e n we have 
fn^fo^gn^fo. 

Thus, with a suitably chosen sequence ( £ n )neN , approximate estimators 
can be regarded as true optimizers of g n , and the stability results can be 
applied also to the case of approximate estimators. 

There are sufficient conditions for the convergence assumptions, which 
open the possibility to reduce convergence of sequences of random functions 
to convergence of suitable sequences of random variables. The approach was 
called pointwise approach in [20] , [11] and scalarization in [6]. It is applicable 
also to dependent sequences of random variables. If a deterministic proba- 
bility measure is approximated by the empiric measure as in section 2, the 
assumptions (Al) and (A2) imply epi-convergence in probability ([22]). 
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Abstract. We formulate an optimal control capital accumulation model with an 
exogenously given time lag between investment and the accumulation of the cap- 
ital stock to analyze the qualitative and quantitative influence of time lags to the 
system dynamics. Optimal investment paths for a finite time lag are shown to be 
cyclic as opposed to the monotone paths for instantaneous capital accumulation. 
Furthermore, we show how to reformulate the retarded differential equation in a 
suitable way so that sophisticated numerical methods for optimal control can be ap- 
plied to analyze the impact of the length of the time lag. It turns out that both the 
frequency and the amplitude of the cycles depend on the length of the investment 
period. 



1 Introduction 

We know from Austrian capital theory [5]: all production takes time. That 
is, the transformation of inputs into outputs does not occur instantaneously. 
However, the common neoclassical theory usually abstracts from the time 
structure of the production process. Exceptions are [4] who derive a gen- 
eralized maximum principle for exogenously given and constant time lags 
between control and state variables. Following an idea first posed in [6], [8] 
empirically analyze in how far time lags between investment and capital ac- 
cumulation can explain business cycles. [1] show that the system dynamics 
of time lagged capital accumulation models can exhibit limit-cycles. 

Different from the authors mentioned above, we explicitly analyze the 
qualitative and quantitative properties of the optimal paths. Therefore, we 
formulate an optimal control capital accumulation model with an exogenously 
given time lag between investment and the accumulation of capital in section 
2. Hence, the dynamics of our capital accumulation model is governed by a 
system of functional differential equations (section 3). In section 3.1 optimal 
investment paths for a finite investment period are shown to be cyclic as 
opposed to the monotone paths for instantaneous capital accumulation. Fur- 
thermore, we present a systematic analysis of the impact of the length of the 
investment period by numerical investigations. We show how to reformulate 
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the retarded differential equation in a suitable way so that sophisticated nu- 
merical methods for optimal control can be applied in section 3.2. In section 
4 optimal paths of capital and investment for different lengths of the invest- 
ment period for the resulting high-dimensional optimal control problem are 
calculated. Section 5 concludes. 



2 The Model 



We analyze an optimal control capital accumulation model similar to the 
neoclassical growth models with one commodity in [3] and [7]. Suppose the 
following intertemporal welfare function W to be maximized 



w{c(t)} = r 

Jo 



V ( c(t )) exp[— pt] dt , 



where p denotes the positive and constant discount rate, r the finite or infinite 
time horizon and V the twice differentiable, monotonic increasing (V 7 > 0) 
and concave (V ,f < 0) instantaneous welfare function. The commodity is 
produced according to a twice differentiable production function P which is 
a monotonic increasing (P 7 > 0) and non concave (P" < 0) function of the 
capital stock k. The produced amount of commodity can either be used for 
consumption c or investment i in the capital stock k. 

To model the time structure of production we assume that capital accu- 
mulation is time consuming: investment at time t is supposed to accumulate 
the capital stock delayed at time t-fcr, where a denotes the positive and con- 
stant time lag between investment and capital accumulation. Furthermore, 
we assume the capital stock deteriorates at the positive and constant rate 7. 

Assuming further that the capital stock k cannot be consumed, i. e. i(t) > 
0, the optimal control problem reads 



max / V{c{t)) exp[— pt] dt s.t. 

Jo 

c(t) = P{k(t)) - i(t) , 
k(t) = i(t—a) — 7 k(t) , 

i(t) > 0 , (1) 

i(t)=£(t), te[-C T,0[, 

k( 0) = ko . 



Because of the retarded differential-difference equation, the specification of 
an initial value for the capital stock k is not sufficient for a unique solution. 
In addition, we have to specify an initial path £ for the investment i in the 
time interval [— <7, 0[. 
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3 Optimal Investment Path 

To determine the necessary conditions for an optimal solution the generalized 
maximum principle in [4] is applied. Hence, the present value Hamiltonian H 
reads 



H = V(c(t))exp[-pt] +p c (t) [ P(k(t )) - i(t) - c(t)} +Pk(t+<r)i(t) 

~Pk{t)lk{t) +Pi{t)i(t) , 

where p c and pi denote the Kuhn-Tucker parameters of the corresponding 
restrictions and pk the costate variable of the capital stock k. Assuming that 
7i is continuous differentiable with respect to i, the necessary conditions for 
an optimal solution read 

dl~L 

= ~Pc(t) +Pk(t + cr) +Pi(t) = 0 , 

^y = V c (c(t)exp[-pt] —p c (t) = 0 , 

= Pc(t)Pk(k(t)) - Pk(t ) 7 = ~Pk{t) , 

Pi(t) > 0 , Pi(t)i(t) = 0 . 

As the Hamiltonian H is concave in k and i these necessary conditions are 
also sufficient, if in addition, the following transversality condition is satisfied 

lim[pfc(£)fc(£)] = 0 . (2) 

t — >T 



3.1 Analytical Analysis of the Optimal Paths 



Assuming an interior solution, i. e. Piit) = 0 for all £, the following system of 
functional differential equations for an optimal solution can be derived 



c{t) 



Vc(c(t)) 



(7 + P) 



V c (c(t+a)) 



V cc (c(t)y' " V cc (c(t)) 

k(t) = P(k(t—a)) — c{t — a) — 7 k{t) , 



(P k (k(t+a)) exp[-pa]) 



(3) 



Although this system is not analytically solvable in general, we can state 
some qualitative properties of its solution. First, we determine the fix point 
(c*, k*) of system (3) by setting c = k = 0. Proposition 1 states the result. 

Proposition 1 (Stationary State). If the production function P is strictly 
monotonic increasing ( P f > 0) and satisfies the Inada conditions (lim^-^o P r = 
00, lim^oo P f = 0) then the system of functional differential equations (3) 
has a unique fix point (c*,k*) t which is unambiguously determined by the 
following equations: 



c* = P(k*) - 7 k* , 
P'(k*) = (7 + p) exp[pcr] . 
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The economic interpretation is straight forward. In the stationary state 
consumption c equals the stationary state production minus the replacement 
of deteriorated capital. Furthermore, the marginal productivity of capital 
P' in the stationary state has to be the higher the longer the time lag a 
to compensate for the waiting period until new investment turns out to be 
productive. As a consequence, if marginal productivity is strictly decreasing 
(P 7 < 0) then the stationary state capital stock is the smaller the longer the 
time lag a. 

Second, we examine the system dynamics in a neighborhood around the 
stationary state. Therefore, we linearize the system of differential equations 
(3) around (c*, k*) derived from proposition 1. Introducing the abbreviations 
A = 7 + p, B = P ff (k*) exp [—per] and C = (7 + p) exp [pa\ the charac- 

teristic equation reads 

0 = x 2 -f £{7 + A(exp[ax] — 1) — Cexp[— ax]} + Ayexp[<jx\ , . 

+ACexp[— ax] — A { 7 -f C} — B . ' ' 

For (j = 0 the characteristic equation (4) reduces to a quadratic equation 
with two real solutions. For a > 0 the equation has in addition an infinite 
number of complex solutions. It can be shown that proposition 2 holds [12]. 

Proposition 2 (Roots of the characteristic polynomial). For positive 
constants A, B and C the characteristic equation ( 4 ) has a unique negative 
real solution x\ < 0 and at least one positive real solution £2 > 0. If the 
time lag is positive a > 0, equation ( 4 ) has in addition an infinite number of 
complex solutions with negative real part and an infinite number of solutions 
with positive real part. 

As there are solutions with positive and solutions with negative real part 
the system dynamics of the (linearized) system of differential equations ex- 
hibits saddle point stability, as the space of solutions decomposes in a stable 
manifold spanned by the eigenvectors corresponding to the eigenvalue with 
negative real part and an unstable manifold spanned by the eigenvectors cor- 
responding to the eigenvalues with positive real part. Similar to the case of 
ordinary first-order differential equations the optimal paths for consumption 
c and the capital stock k in the linear approximation around the stationary 
state are given by c(t) = c* -f c n ex P[^n^] and k(t) = k* + ^ e x P [£ n t], 

where x n denote the characteristic roots, i.e. the solutions of equation (4), 
as well as the c n and k n denote constants which can (at least in principle) 
be unambiguously determined by the set of initial conditions &o, £ and the 
transversality condition (2). 

As a consequence, for an infinite time horizon r the optimal solution con- 
verges asymptotically towards the stationary state to satisfy the transversal- 
ity condition (2). According to the turnpike theorem the system converges 
also for finite time horizons towards the stationary state at the beginning, 
stays in a neighborhood of the stationary state for most of the time and di- 
verges from the stationary state at the end of the time horizon if the time 
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horizon is sufficiently long [11]. Furthermore, the system dynamics exhibits a 
qualitative change by a transition from g = 0 to g > 0. In the first case the 
optimal paths converge strictly monotonic and exponentially, in the latter 
case cyclical and exponentially damped towards the stationary state. 



3.2 Numerical Analysis of the Optimal Paths 

In order to numerically solve (1), we reformulate the problem to make it 
accessible to the advanced optimal control package MUSCOD-II 1 [9] which 
exploits the multiple shooting state descretization [2], [10]. First, we split the 
fixed time interval of length r into n parts each of the length of the time lag 
a and obtain the optimal control problem 

pa n 

max/ V' F(c((i))exp[— p(t + a(l — 1))] dt s.t. 

* 1=1 

ki(t) = f(t,ki(t),i 0 (t),p) , 

k n (t) = f(t,k n (t),i n - i(t),p) , 
with the path constraints 

ci(t) = P(h{t)) - U(t) , 

n(t) > o , / = 1 , 2 , . ..,n . 

The history is given by io(t) = £(£ + g) (t G [— cr , 0]). To guarantee the 
continuity of the differential variables after each time interval g we need to 
introduce linearly coupled multipoint constraints 

r s (si,p)+r e (sf_ 1 ,p) = 0 , l = 2,3,...,n. 

In this context r s (ki,p) gives the initial conditions for ki and r e (fc/_i,p) the 
end point conditions for respectively. Hence, we obtain a boundary value 
problem. 

Second, each time interval of length g is split into m multiple shoot- 
ing subintervals on which the controls are chosen to be constant or piece- 
wise linear which makes the optimal control problem to become a finite di- 
mensional one. The resulting optimal control problem is of the dimension 
(n — l)xm = M which is solved using a direct multiple shooting method 
implemented in the package MUSCOD-II. 

1 MUSCOD-II was developed by the Simulation and Optimization group at the 
Interdisciplinary Center for Scientific Computing, University of Heidelberg. 
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4 An Example: Linear Limitational Production 
Function 

In the following, we show numerical optimizations for a linear limitational 
production function. Indeed, a linear production function does not satisfy 
the requirements of proposition 1. Therefore, in general a unique, positive 
and finite stationary state does not exist. To ensure a unique, positive and 
finite stationary state we assume further that production needs another non- 
producible input factor besides capital, e. g. labor, which is given in constant 
amount l. Hence, production is bounded from above by the amount of avail- 
able labor I and, as long as the accumulation of capital turns out to be 
optimal, we achieve a unique, positive and finite stationary state. The reason 
why we choose a linear limitational production function is twofold. First, if P 
is linear then B = 0 and the characteristic equation simplifies, which allows 
at least a graphical determination of the characteristic roots as demonstrated 
in [ 12 ]. Second, the stationary state does not depend on the time lag a. As 
a consequence, the numerical optimizations we show for different time lags a 
are easier to compare with each other. 

In general, a linear production function has the form P(k(t)) = ao + 
a\ k(t) (ao > 0 , aq > 0 ). A positive constant ao indicates that the commod- 
ity can also be produced by the non-producible factor alone without using 
capital. Without loss of generality, we assume that one unit of labor alone pro- 
duces one unit of the commodity and A units of labor are used together with 
k units of capital to produce one unit of the commodity, indicated by ao = l 
and ai = (1 — X)/k. Hence, the stationary state is given by c* = l/(X + K^y) 
and fc* = kT/( X + « 7 ). Note that in the stationary state the whole amount of 
labor is used to employ and maintain the capital stock. 

Figure 1 shows the results of the numerical optimization, given a linear 
limitational production function . 2 The time lag a varies from 0 to 2.5. As 
supposed the optimal paths converge monotonic towards the stationary state 
for instantaneous capital accumulation ((7 = 0). Most of the time both paths 
remain in a direct neighborhood around the stationary state. Because of 
the finite time horizon investment turns to zero near the end of the time 
horizon. As a consequence, also the capital stock drops. The larger the time 
lag a the more the optimal paths differ from the optimal paths achieved by 
instantaneous capital accumulation and the more cyclical patterns can be 
observed. The optimal paths converge cyclical towards the stationary state 
at the beginning and diverge cyclical from the stationary state at the end of 
the time horizon. The question remaining is, why are cyclical paths optimal, 
i. e. better than monotone paths if a > 0. Due to the cyclical ’’swing- in” 
towards and ” swing-out” from the stationary state the economy can achieve 
a longer phase where all labor is solely used to employ capital which is more 

2 The following functions and constants have been chosen: V(c(t)) = lnc(t), l = 
26§, A = 0 . 8 , k = 0.3, 7 = 0.15, p = 0 . 1 , r = 25, k 0 = 0 and £(t) = 0. 
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a) Scenario 1 (<j — 0) 



b) Scenario 2 (cr = 0.1) 




c) Scenario 3 (a = 1) 



d) Scenario 4 (a = 2.5) 





Fig. 1. Optimal consumption and capital paths for different time lags between in- 
vestment and capital accumulation. The numerical optimization has been executed 
by the MUSCOD-II program package. In the present application we obtain up to 
2500 degrees of freedom! The computing time on a 2533 MHZ Intel P4 machine run- 
ning under Linux varies between 2400 and some 9000 seconds strongly depending 
on the actual number of controls (about 96 % of the computing time is consumed 
for solution of condensed QPs). 



efficient than producing the commodity by labor alone. Beside the inertia 
caused by the time lag there is a another source of inertia, the constancy of 
the capital stock. As negative investment is ruled out, disinvestment can only 
take place by depreciation and is therefore more tedious than investment. As 
a consequence the frequency for the ” swing-out” is smaller than the frequency 
for the ” swing- in” . 



5 Conclusion 

We have shown that time lagged capital accumulation models exhibit in 
general a qualitatively different system dynamics compared to instantaneous 
capital accumulation models. While the optimal paths of the latter converge 
strictly monotonic towards the stationary state, the first show cyclical and ex- 
ponentially damped optimal paths. Furthermore, we have shown how to quan- 
titatively analyze the system dynamics with sophisticated numerical tools like 
MUSCOD-II. Our calculation results suggest that the optimal paths change 
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continuously from strictly monotone to cyclical and exponentially damped 
convergence for an increasing time lag a. 

As a consequence, the standard assumption of instantaneous capital ac- 
cumulation in neoclassical economic theory can be justified as good approxi- 
mation for small time lags a. On the contrary, for large time lags, e. g. in the 
plant construction or pharmaceutical industry, the validity of this approxi- 
mation is endangered. 

So far we have analyzed a centralized economy. A priori it is not clear if 
the well known result of the non retarded accumulation model that a decen- 
tralized market solution is Pareto-optimal turns out to be true in the case 
of time lagged capital accumulation. Intuition suggests that the households’ 
knowledge about the time lag might be crucial. To answer this question fur- 
ther investigations on this topic have to be carried out. 
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Abstract. We introduce a procurement auction model where capacity-constrained 
firms face a sequence of two procurement auctions, each of them in the first-price 
sealed-bid design. Our main findings are that the firms’ entry decisions depend on 
relative project completion cost levels and that equilibrium bidding in both auction 
stages deviates from the standard Symmetric Independent Private Value auction 
model (SIPV) due to opportunity costs of bidding created by possibly employed 
capacity. The model highlights the fact that firms with identical completion costs for 
the first project may differ in entry and bidding strategies. In addition, experimental 
data is reported in order to assess the predictive power of the model. 



1 Introduction 

Theoretical contributions to the analysis of procurement auctions tend to 
focus on the allocation of single projects ignoring outside options of firms, 
e.g. [14], [10], [4], [2], [3]. However, recent empirical research on repeated 
procurement auctions suggests that outside options in the sense of additional 
future procurement auctions of similar projects affect firms’ entry and bidding 
behavior in real life, see [5] and [7]. E.g., the study [7] finds that a firm 
which did not win a highway procurement contract earlier in a sequence of 
auctions run by the Californian Department of Transportation (1994-1998) 
is twice as likely to enter a subsequent auction than a firm which already 
won a (large) contract. This evidence suggests that firms are aware of their 
opportunity costs of bidding created by employed capacity. Thus, firms seem 
to be choosy with respect to entry if facing an auction sequence of non- 
identical procurement contracts and might include these opportunity costs 
in their submitted bids. 

This paper studies this kind of entry decision in the context of privately 
known completion cost rankings and analyzes how firms refine their bidding 
strategies with opportunity costs of early bid submission. Our main theoreti- 
cal findings are that the entry decision depends on relative project completion 
cost levels and equilibrium bidding in both auction stages deviates from the 
standard SIPV model and its sequential formulation with homogenous goods 
due to opportunity costs of bidding created by possibly employed capacity. 
It follows from the analysis that firms with identical completion costs for the 
first project may differ in entry and bidding strategies. 

In addition, this paper presents experimental evidence for our sequential 
procurement auction model that suggests that its theoretical implications 
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might explain observed patterns of entry behavior in repeated real-life pro- 
curement auctions. In turn, this finding points to an explicit role for the 
auction environment in empirical studies on static procurement auctions. 

2 Model and Equilibrium Behavior 

We consider two risk-neutral firms with capacity to complete a single project 
due to capacity constraints. Completion costs for two subsequently auctioned 
projects, L and M, are private information to each firm. It is common knowl- 
edge that firm Vs costs of completion are jointly drawn from f(k,nii) with 
domain [c,c] and stochastic equivalent in the sense of /(/,ra) = /(m, /) for 
every (Z,m) G [c,c] 2 implying E[Li\ = E[Mi\. It follows that each firm faces 
either lower completion cost for project L or project M. If cost realizations 
of a firm are such that l < m, this firm is said to have a cost advantage for 
project L , the reversed inequality indicates a cost advantage for project M. 
Although completion costs of a single firm may be correlated across projects, 
pairs of completion costs of different firms are independently distributed. 

In each procurement auction, a participating firm may submit a sealed 
bid where the lowest bid wins the project and the amount bid is paid in ex- 
change for completion of the project. However, bids cannot exceed maximum 
completion costs c which may be interpreted as the procurer’s outside op- 
tion, otherwise infinite prices result. We assume that the auctioneer cannot 
set a price below maximum completion costs c and that resale of projects 
is not feasible. If there happens to be a bidding tie, any auctioneer employs 
a fair chance mechanism to break it. The sequence of auctions begins with 
the procurement auction of project L where the winner is announced before 
project M is auctioned off. Thus with two firms, any firm can infer if it faces 
competition in auction M before it submits its bid. 

In addition to equilibrium bidding functions for each auction stage, b L 
and b M , a firm’s strategy also includes a decision to submit a bid in the 
first auction or skip bidding for project L. In general, firm 1 participates in 
auction L if its expected profit from bidding exceeds the opportunity cost 
arising from possibly being excluded from bidding for project M, formally 

E{n^ +M \(h, mi )} > Ein^Kiurm)}, 

where E[IJ^ +M |(Zi,TOi)] denotes firm l’s expected profit if it bids in the 
procurement auction for project L and - if unsuccessful - continues bidding 
in auction M and E[II^\(li,mi)] is its expected profit if it skips the first 
auction and bids only for the subsequently auctioned project M. 

The firm’s decision to submit a bid in auction L depends on the relation 
of its project completion costs. In order to formalize the entry decision, we 
introduce the critical- value function g \ : [c, c] — > [c, c] which specifies a cut-off 
point for completion costs of project L , depending on completion costs of 
project M, beyond which it is not worthwhile for firm 1 to participate in the 
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auction of project L. Specifically, the decision rule to submit a bid for project 
L is given by entry function e (•) as follows: 



£i(/i,rai) = 



Enter Auction L if < gi{m\) 
Skip Auction L if l\ > gi{m \) , 



where the critical- value function = gi{m\) is implicitly defined by the 
equality of expected profit from entering auction L and corresponding oppor- 
tunity cost: 



E [iTf +M | mi)] = E [n?\ (if* mi)] . (1) 

By definition, firm 1 is indifferent between entering auction L and skipping it 
if its completion cost pair satisfies Zf rU = gi(mi). In symmetric equilibrium, 
equation (1) is given by (for details see [12]): 



n c — m ( 2c — [g(m) -f m\ 
d a /-> 



c c 

f J f(x,y)dx 



dy 



£ 9(y) 
c g(y) 



£ g(y) 



+ [c- g(m )] // f(x, y) dx dy — (c — m) // f{x, y) dx dy 

C C 

c c 

-// (: y-m ) • f{x, y) dx dy . 



m a(y ) 



The properties of the critical- value function g(m) in symmetric equilibria are 
summarized in the next proposition that is proved in [12]. 

Proposition 1. For all symmetric perfect Bayesian equilibria characterized 
by the representative firm’s strategy [b L (l,m), b M (m), e(m)] and the density 
function /(/, m): 

(a) There exists a (nonempty) compact and convex set of completion cost 
pairs where it is rational for a firm to bid for project L although it has 
a cost advantage for completing project M. This subset is defined by 
G = {(/,m) g [c,c] | m < l < g(m)}. 

(b) The critical value function g(m) exists and 

(i) m < g(m) < c f . m e [c,c), g(c) = c, g(c) > c, 

(ii) g'(m) > 0, 

(iii) g"{m) < 0 f . m e [c,c) and g"(c) = 0. 



It follows from proposition 1 that a firm always enters auction L if it faces a 
cost advantage for this project, i.e. I < m. Then it can earn at least c — m. In 
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contrast, a cost advantage for completing project M implies the impossibility 
of the firm to secure itself the same return in auction L as it could earn in 
auction M being the only bidder. However, if the competing firm skipped 
auction L, too, then there is competition in the second auction with the risk 
of low or even zero profits due to aggressive bidding. Therefore, a firm with 
lower cost for project M may wish to participate in the first auction and 
win the unloved project L at a high price to insure itself against low profits 
resulting from fierce competition in the second auction, although it actually 
prefers losing the auction for project L. Figure 1 illustrates these results for 
a representative firm with completion costs (Z,m). 




Fig. 1 . A Typical Critical- Value Function g(m): 

If the firm submits a bid in the first auction. A firm with relatively high 

cost for completing the first project, i.e. I > g(m ), does not submit a bid. 

The symmetric equilibrium bidding strategy in a one-shot first-price auc- 
tion is well-known. For a discussion see e.g. [9] and [16]. However, in our 
dynamic setting additional issues arise. Consider first the auction for project 
L. Any of the two firms participating in the first auction anticipates that if it 
does not win project L, it remains the only bidder in the subsequent auction 
M and receives c — m. Thus, it may submit a very large bid for project L 
since it is, at least partially, insured against losing auction L. A firm with a 
cost advantage for project M knows that it cannot achieve such a high return 
in auction L as it would receive by winning the second auction after it lost 
the first one. Thus, provided the firm decides to participate in auction L, it 
minimizes chances of winning project L by submitting the highest feasible 
bid. In contrast, if a firm has a cost advantage for project T, it tops its com- 
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pletion cost l with its certain return from auction M and uses the revised 
cost parameter l = l + c — m in auction L. 

If there is no bidding competition in the auction for project M, then any 
firm bidding for it will submit the maximum feasible bid to maximize profits. 
In case of bidding competition, the updated belief concerning the competitor’s 
cost parameter for project M takes into account that it also skipped auction 
L which may not be equilibrium behavior for every type. The appropriate a 
posteriori pdf is denoted by /M|Skip( m ) and gives the (equilibrium) density 
that a firm with completion cost realization m for project M bids only in 
auction M. 

The equilibrium bidding functions are summarized in the next proposi- 
tion, for a proof see [12]. 



Proposition 2. Equilibrium Bidding Functions in Auctions L and M 
The equilibrium bidding functions of a firm with cost pair (/, m) £ [c, c] 2 are 
given by: 



) c if l >m 

1 + otherwise 

if it submits a bid for project L where ( x ) = f* f(m — c+l,m) dm dl 

with x , l £ [c, c] and l = l + c — m, and 

(c if it is the only bidder 



b M (m) — 



m + - ^ l 1 FM \ Ski p( x )] dx otherwise 

m + i-F M \sk ip (m) otherwise 



if it submits a bid for project M where g{x) denotes the competitor’s critical- 
value function, f M \ski P {x ) = fg (x )f(y> X ) d y /Icfg(s) f(y,s)dyds and 

F M\Skip ( x ) = f c f M\Skip{ s ) ds. 



3 Impact of Auction Environment on Bidding 

In this section, we briefly demonstrate how bidding behavior in the first auc- 
tion varies with the value that a firm places on the opportunity to participate 
in a second auction. This option value itself depends on a firm’s completion 
cost for the second project. For the purpose of illustration, consider a specific 
example with two firms where completion costs are distributed uniformly: 
(Z,m) - Z7[20, 100] 2 . 

(a) (Base Scenario): Suppose the completion cost for project M to be fixed 
at some level below maximum completion cost, say m — 80. The bidding 
function for the first project L is 

2 l 3 +301 2 — 1,664,000 

3 * l 2 - 12,800 

100 



b L (l,m = 80) = 



l < 80 
l > 80 . 
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Figure 2 illustrates that bids in the dynamic auction environment with 
m = 80 substantially exceed bids in a one-shot auction determined by 
b{l) given below. 




Fig. 2. Bidding for Project L under Various Outside Options 



(b) (One-Shot Auction) There is no second auction such that the first auction 
reduces to the standard SIPV bidding function in a procurement context: 



b(l) = 50 + 0.5 1 



(c) (Virtually No 2nd Auction): Consider base scenario (a) with maximum 
completion cost m = 100. Compared to & L (/, m = 80), the larger comple- 
tion cost m shifts the bidding function b L (l,m = 100) downwards, 



6 l (/, m — 100) = 



2 

3 



l 3 -SOI 2 - 1,660,000 
l 2 - 12, 400 - 40/ 



The exemplified change of b L (Z, to) in response to increases in m illustrates 
typical comparative static behavior. Note that bids with virtually no 
second auction do not coincide with bids in the one-shot auction since 
completion costs are private information. 



4 Experimental Results 

The preceding section highlighted the fact that variations of the second round 
auction game change the equilibrium bidding function in the first round. In 
particular, larger cost for completing the second project, which correspond 
to a lower value of the second round game, lead to more aggressive bidding 
for the first project. This theoretical prediction and that on entry behav- 
ior are fulfilled in the laboratory implementation of our auction model. We 
sketch some of the results that are obtained by Brosig and Reiß in a study 
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of sequential procurement auctions at the Magdeburg Laboratory for Exper- 
imental Economics (MaxLab), see [1], 

Figure 3 summarizes data on entry generated in one of the treatments 
where 24 subjects played the procurement auction sequence, each of them 
with 28 pairs of completion costs. Each marking in the (m, /)-space represents 
one completion cost pair. The size of the markings indicates the frequency 
of decisions on entry in line with the theoretical prediction relative to all 
observed decisions on entry for that cost pair. Out of a total of 672 observed 
entry decisions, approximately 70% are correctly predicted by our theory. It 




Fig. 4. Observed Bidding for Project L 



is apparent from figure 3 that the number of correctly predicted entries rises 
as the cost pair is farther away from the critical- value function. In the vicinity 
of p(m), a false entry decision is less costly and on its graph, the cost is zero 
by definition. Thus, the theory’s predictive power increases as the expected 
cost of incorrect entry is larger, which is rigorously confirmed in [1]. 
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Figure 4 depicts average bids for project L as a function of l for two differ- 
ent cost levels for the second project. Apparently, observed bids for m= 40.57 
(significantly) exceed those for m=6 0.12 in the relevant range 20-60.12 which 
is in line with our sequential procurement auction model, see section 3. Both 
bid samples (significantly) exceed predictions of the standard one-shot auc- 
tion model. Since the overbidding phenomenon in standard auction experi- 
ments translates to underbidding in the procurement auction context, this 
fact is particularly remarkable and strengthens the suggestion that subjects 
include opportunity costs of early bidding in their bids for project L . 
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Abstract. The World Wide Web (WWW) contains millions of hypertext pages 
that present nearly all kinds of information. Specific effort is required to use this 
information as input to subsequent computations or to aggregate values in web 
pages. To do so, data from webpages are extracted and stored on computers either 
in text files or databases. These manipulations can be better attained by using an 
autonomous software program instead of human personal. Here, we present a plat- 
form independent software agent called PISA (Partially Intelligent Software 
Agent) that extracts financial data autonomously from webpages and stores them 
on a local computer. Data quality has highest significance. PISA generates time 
series with user defined denseness. These time series have adequate quality for fi- 
nancial market analyses, e. g. forecasts with neural networks. 



1 Introduction 

Financial market websites contain financial market information from banks, bro- 
kers, exchanges and financial service providers, e. g. stock quotes, option prices, 
exchange rates in particular and other information concerning exchange markets. 
The internet offers these data in many cases near time. Comparable up-to-dateness 
usually is only offered by commercial finance databases that must be paid. Fees 
are usually high. The internet often offers the same information cost free. Here, 
up-to-dateness and cost-freeness are exploited to build a financial database for 
free. The database’s quality is as good as of commercial financial databases. Fi- 
nancial market websites usually do not contain static but dynamic content. The 
presented data change frequently. To minimize work the presented data are usu- 
ally stored in databases. When a webpage is requested by a browser the needed in- 
formation is queried from the database and the results are put into a specific tem- 
plate. Templates are a skeleton of the resulting pages which contain specific tags. 
These tags define where specified pieces of information are filled in. This results 
in highly structured webpages. Since usually one single template is used for many 
kinds of webpages, once a scheme is recognized, this scheme can be used to iden- 
tify the demanded information on other pages of the same website. Here, schemes 
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are used to extract specified information to generate not just a database but dense 
time series. A time series is defined as a series or function of a variable over time. 
This means that a particular variable takes a particular discrete value at a sequence 
of points in time. Here, quotes are used as variables. Time series can be used to 
train artificial neural networks. E. g. the FAUN 1 neurosimulator project uses neu- 
ral networks to predict real market option prices, see [2], and to make short term 
forecasts, see [5]. Those neural networks need input data with highest data quality. 

Here, we present the platform independent software agent PISA to generate 
time series. The resulting time series are capable of being used for neural network 
training. Major problems of web-mining that usually effect output data quality are 
prevented. Primary problem is that most webpage's structure changes frequently 
and the position of information might change. In this case either no information or 
wrong information might be extracted. No information is as well extracted if a 
website is not available for a certain time. In cases information is distributed to 
different webpages, data from different webpages must be aggregated to realize 
added value, e. g. a price difference for arbitrage trades. To enable time series with 
flexible denseness the agent has to extract wanted information in adequate small 
intervals. As the Internet is an international medium websites are formatted with 
several international formats like for date, time and numbers. Most existing 
web-mining programs are designed to extract the text representing these data. To 
assure highest data quality date, time and numbers need to be consistently format- 
ted. The agent's data output limits further processing possibilities. Therefore, both 
text files and databases have to be supported to store the extracted data. 



2 Software-Agents 



2.1 Agent Paradigm 

Primary advantage of using an agent is that agents can work very efficiently 
24 hours a day and 7 days a week (except breakdowns and maintenance work). 
Agents can handle dozens of extraction operations per minute automatically. Able 
to work long periods of time with low costs software agents are well qualified for 
web-mining tasks. 

There is no generally accepted definition of the term software agent although 
the difference between normal programs and software agents has been discussed 
intensely for many years now [cf. 4, 3]. A common characterization was disposed 
by Jennings and Woodridge [cf. 7]. Their definition is the origin for almost all cur- 
rent research on agent technology. Accordantly an agent is a representative who 
works on behalf of a person and has the following attributes: Autonomy - The 
agent should be able to execute the assigned tasks on its own without any call- 



1 FAUN = Fast Approximation with Universal Neural networks 
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back. Social behavior - Agents interact with other agents and at least with the 
user. Ability to react - Perception of the system environment the agent is "living" 
in and the ability to react on basis of more or less precisely defined decision pat- 
terns. Consciousness - An agent does not only react on events but can anticipate 
future incidents. The proficiency of the four characteristics depends on the agent's 
aims. Here, the agent has to receive and process webpages automatically. Auton- 
omy is required to work over a long period of time without necessary user interac- 
tion. User interaction is however necessary for configuration. This requires only 
little social behavior. The agent has to react on the perceived situation. Conscious- 
ness is not necessary since all necessary decisions can be made using hard coded 
rules. Case differentiations within the program code are sufficient because all pos- 
sible cases are a priori known. As the structure of the processed webpages is 
known in advance the agent just has to filter user specified patterns without 
"thinking". This does not suffice to call the agent intelligent. The presented agent 
is called partially intelligent and its intelligence will be further developed. 



2.2 Agent Requirements 

Usually financial market webpages contain several pieces of independent informa- 
tion on a single website, e. g. stock quotes of a specific index. These information 
chunks have to be correctly and reliably identified, extracted and saved. Each step 
requires specific abilities of a web-mining agent. 

Receiving webpages: To receive a webpage a request is send to a Webserver 
using TCP/IP-protocols which have to be supported. If the information containing 
webpage's URL (Uniform Resource Locator) is not a priori known crawling meth- 
ods are mandatory. The agent must recognize if a webpage contains relevant in- 
formation or not. Here, for neural network training a continuous data flow is 
mandatory. The agent has to be permanently available during trading hours. 
Referring to the need of efficiency the agent should only work if it is reasonable. 
Financial websites are only updated when a change of the underlying data occurs. 
In times with only few changes processing frequency can be decreased. Timer 
functions enable reasonable system utilization. Extraction intervals must be as 
small as possible to enable time series with optimal denseness. Minimal system 
utilization has high priority. 

Extraction: Dealing with HTML (Hypertext Markup Language) documents the 
structure is not always completely defined and can be irregular. HTML documents 
can contain errors. Missing tags are a common example for these errors. Since 
browser programs handle these problems they are often not noticed by users 
and/or webmasters. The agent has to recognize and handle such problems to as- 
sure error tolerant HTML parsing. Once a webpage's source code is received and 
parsed regular patterns are advisable to identify and extract complex patterns from 
HTML source code. String Tokenizer methods are less powerful than regular ex- 
pressions but they are usually faster. Both should be supported. 

The internet offers financial data from all over the world. Dependent on the tar- 
get group different international number, time and date formats are used. These 
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have to be recognized and reformatted in user defined formats. This increases 
flexibility for further processing programs. Some important information, e. g. date 
and time of a quote, is often split into multiple pieces. The agent has to be able to 
merge them. Therefore, as well as for adjusting different time zones date, time and 
number information has to be transformed into numbers. All extracted values have 
to be accessible as variables to calculate new values and to merge distributed 
items. 

Data storage: File handling methods are mandatory to save extracted patterns. 
The user should be able to choose an output file format. Both plain text files and 
XML-files (XML = Extensible Markup Language) should be supported. Large 
amounts of data can be handled easier stored in a database instead of text files. 
The most common protocol for accessing databases is the ODBC-Protocol (Open 
database connectivity) which should be supported by the programming language 
as well. 

Beside the mentioned requirements there are some general ones. The agent 
should be as platform independent as possible to assure flexible application. The 
hazard of breakdowns has to be minimized to assure a continuous data flow. Input 
data has to be correct. Accurateness is a very important aim. The agent has to pro- 
vide rules with which extracted data can be checked on plausibility. 



2.3 Existing Agents 

Web-mining agents are developed for several years now. Usually web-mining 
agents and web-crawlers are developed for a specific task. This explains several 
drawbacks which are summarized here. 

All considered programs are able to request and receive webpages. Missing 
timer functionality prevents that extraction tasks can be executed in specified in- 
tervals. Performance is further affected by missing multithreading support. Most 
agents support adequate crawling methods. Usually regular patterns are used to 
identify and extract pieces of information. The relative position of a pattern to an- 
other pattern is usually not supported. The position within the source code can 
only be defined by generating a complex pattern. The HTML structure is hardly 
taken into account. The resulting extraction rules are vulnerable for errors. Even if 
the right value is correctly extracted often no formatting methods are provided. 
Also most wrapper tools are only capable of saving the extracted results in plain 
text files. Only few of them support XML. ODBC-support is very seldom. 

The mentioned drawbacks do not appear for all considered agents. No program 
is fully capable for the given task. Upgrading existing programs fails since the 
considered programs are usually not well documented and the source code is not 
accessible. Inadequate extensibility and missing functions are sufficient reasons to 
develop an own web-mining agent. An overview for public domain and commer- 
cial web-mining agents is accessible in [6]. 
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3 Software Agent PISA 



3.1 Design and Implementation 

The mentioned requirements lead to special demands for the language PISA is 
programmed in. The major considered languages and their attributes are shown in 
Table 1 that summarizes the results of a detailed consideration [cf. 1]. The lan- 
guages are differently applicable. Most missing functions can be extended using 
public domain modules. Since these programs are usually not well documented the 
language should support the features inherently. Here, Java is the most suitable 
programming language to achieve the mentioned goals. 



Table 1 . Overview of considered programming languages. 



Functions 1 Languages ■=> 


PHP 


Java- 

Script 


Perl 


C++ 


c# 


Java 


Internet functions 


V 


S 




V 


V 


V 


Regular expressions 


S 


S 


✓ 


S 


s 


S 


String tokenizer functions 


V 


S 


V 


V 


s 


S 


Multithreading 


X 


X 


S 


s 


s 


✓ 


Error handling 


X 


X 


X 


s 


V 


V 


Timer functions 


X 


X 


X 


(*) 


s 


V 


File handling 


S 


X 


V 


s 




V 


ODBC database support 


S 


X 


S 


X 


✓ 


S 


Remote method invocation 


X 


X 


X 


V 


✓ 


✓ 


Platform independency 


✓ 


S 


✓ 


✓ 


X 





PISA is completely realized in Java and consists of five components, shown in 
Figure 1. The component PisaMain initiates and starts all user defined extraction 
tasks. Specifications are taken from a configuration file. The initiated tasks run as 
independent threads and are executed simultaneously. Each task is represented by 
a single PisaCrawler object. These objects request the defined webpages and ap- 
prove that during the crawling process no webpage is requested multiple times. 
Each received webpage is process by the HtmlDocument component that parses 
the passed website's source code. The source code is further processed by the Pis- 
aGrabber component which identifies and returns the user wanted patterns. The 
extracted data are saved either in a plain text file, XML-file or a database. 



3.2 Functionality 



Due to the dynamic nature of the web, most information extraction systems focus 
on specific extraction tasks. Here, we concentrate on agent based generation of 
dense time series. The specific problems are focused here. 

PisaMain: PISA starts with executing the main module PisaMain that initiates 
the extraction tasks. They are defined by the user in a file with a specific syntax. 
The PisaMain-object starts one PisaCrawler-object per URL. These Pisa- 
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Crawler-objects are started with a one second time delay, each. For dense time se- 
ries the request interval is very small. If too many pages are requested from a Web- 
server too frequently, the Webserver might crash or it does not answer some re- 
quests. Latter results from a standard mechanism to avoid Webserver overload by 
ignoring requests when a specified number of requests in a period is exceeded. 
This results in information gaps in the time series. The delay time is adjustable. 















PisaMain 
Control module 


► 


Fisa Crawler 

Loads websites and extracts 
Hyperlinks 





PisaGrabber 
Extracts the demanded 
inform at Sen from a document 



HtmlDocument 
Parses the recieved 
I I I MI -Document 



Fig. 1. Major modules of PISA. 

PisaCrawIer: Each PisaCrawler-object is executed in an adjustable interval. 
The interval is defined in seconds to enable dense time series. Shorter intervals are 
possible but not necessary since financial quotes are updated at most every sec- 
ond. Without given interval the PisaCrawler-object terminates itself after the first 
evaluation. 

The PisaCrawIer component crawls websites either at every execution or just 
once at the first run. In this case PISA recognizes interesting webpages by user de- 
fined requirements and memorizes the URL. Future accesses use this address. 
Each requested webpage is represented by an HtmlDocument-object and is further 
processed by the PisaGrabber-object. 

HtmlDocument: The evoking class passes an URL. The HtmlDocument com- 
ponent requests and analyzes the according webpages. PISA handles common 
syntactical errors reliably. Therefore, an error tolerant HTML parsing process is 
realized. The source code is converted into XHTML compliant text. Afterwards, 
all needed tags are identified using regular expressions for start- and end-position 
of a tag. Only needed tags are processed to decrease processing time. Once a tag is 
identified its attributes like size, color and content are analyzed and stored in a 
tag-object. This tag-object represents the HTML tag. For each kind of tag an array 
is created that contains the objects of a kind in order of appearance. This enables a 
successive comparison of the array fields and the search for a special pattern. 

PisaGrabber: The PisaGrabber module extracts the demanded patterns from a 
passed HtmlDocument-object. The easiest way to extract a pattern is successive 
comparison of each array field with the wanted pattern. This approach is neither 
comfortable nor capable because the number of appearance might change. If a 
stock's bid-price is appearance number two of a 2-digit number today, it can be the 
third one tomorrow. Here, the number of a requested pattern is defined relative to 
an anchor. This anchor is also defined by a pattern. An example clarifies this pro- 
cedure: A typical table with stock prices is shown in Figure 2. The last given price 
can be found by using a pattern for a 2-digit decimal number. The current date can 
be used as the anchor. The current price's position is the forth table cell after the 
current date. Both patterns are specified by regular expressions. 
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Fig. 2. An example of a webpage presenting the quotes of the Siemens AG at the NYSE. 



Using this approach the user has to know four things: 1. The pattern of the re- 
quested information; 2. The anchor pattern; 3. The number of tags between an- 
chor-pattern and wanted information; 4. The kind of tag the patterns are formatted 
with. Optionally names for each extracted bit of information can be defined. This 
enables storage in platform independent XML-files. The names can be used like 
variables either to calculate new values or to merge several bits of information, 
e. g. a complete date that is split into data and time. If the user specifies a time 
zone PISA is working in, extracted worldwide times are converted in local time. 

To assure high data quality, accurateness of the extracted data is very impor- 
tant. Information items can be defined as mandatory. If an object is declared as 
mandatory and not available on a webpage the whole dataset is abolished. In some 
cases quotes are published with a certain time delay. If the quote date is not avail- 
able the current date is extracted. Time of quote and date of visit might not match. 
E. g. if the time delay is 10 minutes the current time is 08/17/03 12:05 am when 
the quote time is 11:55 pm the day before. Merging current date and time of quote 
results in a future time, i. e. 08/17/03 11:55 pm. PISA accomplishes this problem. 
Additionally rules check the extracted data if they fit certain criteria, e. g. it has to 
be within a specified fluctuation margin. Extracting data from several webpages 
leads to the problem that the display format of numbers and dates do most likely 
differ from each other. PISA formats text, numbers and dates in adjustable formats 
to facilitate import in retailing programs. 



3.3 Examples 

PISA was tested in detail in [1]. Here, we summarize the results. We tested the 
agent in different environments and for different tasks. The underlying website 
specific schemes have been generated manually. 

To test the crawling function we decided not only to use financial websites be- 
cause the URL of specific information is usually a priori known. Therefore eB ay- 
customer profiles were generated. Starting from an eBay-user’s feedback page the 
agent followed only the links to auction pages. These links were recognized by a 
specified pattern given by the user. PISA extracted auction details. Such user pro- 
files are interesting for cross-selling activities. 

To test PISA’s performance we extracted prices for 60 German options from 
three different websites, see [1]. All options were extracted from different pages. 
The 180 pages were processed with an interval of 2 minutes each. The system 
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worked reliably and stable. Because of the resulting system utilization a high- 
capacity computer is recommended to keep processing times adequate. The result- 
ing time series are used for generating real market option prices, see [2]. 

PISA extracted currency exchange rates for US Dollar and Euro from 06/03/03 
to 07/16/03 from Finanztreff (www.finanztreff.de) with an interval of 10 seconds. 
Beside the current bid- and ask-price also date, time and German security identifi- 
cation number were reliably extracted. The results are used for short term fore- 
casts. As the results in [5] show the data quality is very high. At most 2 or 3 values 
are missing in a row in the time series. Theses gaps are filled by using linear ap- 
proximations. Reasons for missing values are most likely network failures. 



4 Conclusion 

Tests showed that PISA generates high quality data sets, e. g. for neural network 
training. Even a high number of webpages can be processed in short intervals. In- 
tervals can be defined by the user approximately. The process is only limited by 
the computer's performance the agent is running on. 

Even if the extraction process works well some limitations are left that affect 
data quality. Network failures, server sided blackouts and maintenance work make 
page requests impossible. Another source of errors are significant layout changes 
of a webpage. Today, only little changes can be anticipated by PISA. 
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Abstract. Several methods have been developed over a number of years for solv- 
ing decision problems when vague and numerically imprecise information prevails. 
However, the DELTA method and similar methods give rise to particular bilinear 
programming problems that are time consuming to solve in a real-time environ- 
ment. This paper presents a set of benchmark tests for non-linear programming 
solvers for solving this special type of problems. With two existing linear program- 
ming based algorithms, it also investigates the performance of linear programming 
solvers for special decision situations in decision analysis systems. 



1 Introduction 

With the rapid development of graphical user interfaces, it is possible to 
bring the use of sophisticated computational techniques for decision analysis 
to a broader group of users, and many decision analytic tools have emerged. 
However, most of them consist of some straightforward set of rules applied to 
precise numerical estimates of probabilities and values no matter how unsure 
a decision maker (DM) is of his/her estimates. The requirement to provide 
numerically precise information in such models has often been considered 
unrealistic in real-life decision situations. Besides, sensitivity analysis is often 
not easy to carry out in more than a few dimensions at a time because of 
precise figures. When a DM is faced with a decision problem that could not 
be directly judged by his/her empirical experience, or according to available 
historical data, a module allowing imprecision is obviously of great value. 

A number of techniques allowing imprecise statements have been sug- 
gested, but they focus more on representation and less on evaluation. In spite 
of several years of intense activities, only a few decision tools, for example, 
ARIADNE, DecideTT and Winpre, can evaluate imprecise estimates. Among 
these tools, the DELTA method, which was proposed in [2], acts as the basic 
theory for DecideTT, and has been used for decision problems like [3], [4], [6], 
[7], [8], by allowing the analysis of decision situations containing imprecise 
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information represented as intervals and relations. The purpose of this paper 
is to investigate the performance of modern combined linear programming 
(LP) /non-linear programming (NLP) solvers when we try to extend DELTA 
into the evaluation of general decision situations. 

The next section describes some contents of DELTA related to this paper, 
analyzes the special bilinear programming (BLP) issue arising from DELTA, 
and investigates some related work. The penultimate section is devoted to 
the simulation study, which is followed by conclusions and future work. 

2 The DELTA Method 

The decision tree in Fig. 1 represents a decision situation where D 1 is a deci- 
sion node, and El and E2 are probability nodes representing indeterminism 
with associated probability distributions. The leaves are consequence nodes 
with associated value or utility functions. 




p Tot.:Ip. 1] 
V T ot.:[0. 1] 



P Tot.: [0. 1] 
V T ot.:[0. 1] 



P Tot.:[P. i] 

V Tot.rlP. 1] 
P Tot.:[0. 1] 

V Tot.: |p . 1] 



P T ot.:|0. I} 
VTot. IP. 1] 
P Tot.: [P. 1] 
V T ot.:|p. 1] 



Fig. 1. A Decision Situation 



In DELTA, a decision frame represents a decision problem. The idea 
behind such a frame is to collect all information necessary for the model 
in one structure. This structure is then filled in with user statements rep- 
resented as linear inequalities. User statements can be a range constraint, 
Xi G [a, b], a comparative constraint, X{ — Xj G [a, 6], a difference constraint, 
(xi—Xj) — (xk—xi) G [a, 6], and a compound constraint, x ^ -K . . G [a, 6] 

with respect to probability and value, respectively. All these statements are 
translated and collected together in a probability base (P-base) and a value 
base (V-base). The structure -< P, V >- is then referred to as a decision frame. 

Given a decision frame -< P,Vy, the primary evaluation rules in DELTA 
are based on pairwise comparisons using a generalization of the principle of 
maximizing the expected utility. Taking the decision situation as shown in 
Fig. 1, a typical problem is to maximize the expression: 

2 4 

max(J2pik v i k - J2 P2 * V2 ^ 

k = 1 k=l 
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where P and V consist of variables coming from P-base and V-base ; k rep- 
resents the index of the consequences within an alternative; Cp and Cy are 
translated linear inequalities to express imprecise statements regarding P-base 
and V-base ; and L and U are lower and upper bounds for those inequalities. 
(1) can be easily mapped into the standard quadratic programming problem. 

To analyze (1), firstly, assuming that imprecise statements appear only in 
one base, while the other has precise estimates, (1) reduces to an LP system. 
Next, if imprecise information exists in both bases, (1) gives rise to a BLP 
problem because of its quadratic term p-v. Moreover, when trying to compute 
the difference between the expected values of two alternatives, we could also 
obtain a negative value. This fact means that (1) is indefinite, and thus leads 
to the global optimization area. Since we prefer to take the two-phase strategy 
as in in], this benchmark focuses on the local optimization phase. 

Our first choice is the revised active set method because DecideTT needs 
to maintain a feasible solution during the calculation. Today, research on this 
issue chiefly concentrates on solving large-scale optimization problems rather 
than relatively small and sequential problems, according to the contraction 
method in DELTA, to handle sensitivity analysis. Hence, some earlier work 
seems more valuable. The original attempts to solve a BLP problem by ap- 
plying the active set method dates back to [1], [5], [10], [12], and more. Recent 
work, for example, [9], focuses on how to update the matrices in use efficiently 
and make use of the previous information. This is the essential point that 
causes the revised active set method to be fast. Nevertheless, just as there 
are two sides to a coin, it is also this point that causes the revised active set 
method to be slow because there is only one constraint entering or leaving 
the active set at every step. Some other research work has already attacked 
(1) successfully. As proposed in [2], two LP based algorithms, Probability 
Bilinear Optimization (PBO) and Value Bilinear Optimization (VBO), can 
reduce (1) into an LP system, but a DM has to rule out certain statements. 

3 Simulation Study 

3.1 Preconditions 

The NLP and LP solvers are SNOPT and SQOPT, respectively, which were 
originally developed by Systems Optimization Laboratory (SOL), Stanford 
University. All simulation study work takes place under Win2000, Matlab6.5, 
Tomlab3.1, Pentiumlll 1000MHz processor and 512M memory. 

3.2 Comparisons between PBO and VBO 

PBO and VBO have very similar structures except for 2 normalization con- 
straints in the P-base. We apply SNOPT and SQOPT to the data sets gen- 
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erated according to the demand of PBO and VBO, respectively. This ex- 
periment makes use of 10 groups of data for PBO. Each group consists of 
instances from 51 to 250 consequences where each instance has around 2 N 
constraints, making a total of 10 x 200 = 2000 simulated decision situations. 
By analogy, there are also 2000 instances applied to VBO. Experimental re- 
sults are demonstrated in Fig. 2. 



SNORT 




Fig. 2. PBO vs. VBO 



It can be observed that for these two specially defined decision situations, 
SNOPT has a better and more stable performance for VBO than for PBO; 
while on the other hand, SQOPT indicates that to solve a PBO problem 
is faster. Both facts suggest there must be some difference between PBO 
and VBO. This difference could serve as one of the research directions. If 
we could realize and eliminate this difference, a generalized version of an LP 
based algorithm could be obtained. 

3.3 Comparisons between BLP and LP 

With PBO and VBO, it is possible to compare BLP with LP. The purpose is 
to identify how large the gap is between them. The same data sets are applied 
as in the last experiment. Figure 3 demonstrates their performance. Table 1 
provides numerical results. It divides the data into 4 sections and calculates 
the average execution time of these 10 groups of data. The gap indicates how 
much faster the LP algorithm is compared to the BLP algorithm. 

It can be observed that for VBO, the gap between LP and BLP algorithms 
is around 3.5. This is because SQOPT performs more poorly and SNOPT 
performs better for VBO as indicated in Fig. 2. Nevertheless, the situation 
reverses for PBO, which makes its gap much more than 10. Consequently, 
the research work for a better BLP algorithm seems reasonable. Moreover, 
as (1) contains such a special structure, this also makes the idea possible. 
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Fig. 3. Revised Active Set Method vs. PBO and VBO 



Table 1. Numerical Results 



Consequences 


51-100 101-150 151-200 201-250 


PBO SNOPT 


0.3320 


0.9098 


1.9729 


4.7723 


SQOPT 


0.0186 


0.0311 


0.0545 


0.0981 


Gap 


17.8599 


29.2718 36.2024 48.6389 


VBO SNOPT 


0.1111 


0.2449 


0.4460 


0.7457 


SQOPT 


0.0330 


0.0697 


0.1216 


0.1948 


Gap 


3.3658 


3.5138 


3.6660 


3.8273 



3.4 Impacts from the Number of Constraints 

Strategy 1 In this strategy, we apply the simulated decision situation con- 
taining two alternatives, each alternative with N = 150 consequences (600 
variables), and with around 2N (300) constraints. As for handling the num- 
ber of constraints, we add them one by one, i.e., from 1 to 2 N. Decision 
situations with N = 200 and N = 250 consequences are applied analogously. 
This experiment applies to 25 groups of data. Each group consists of three 
instances containing 150, 200, 250 consequences, respectively. Correspond- 
ingly, a total of (300 + 400 -f 500) x 25 = 30000 simulated decision situations 
are computed. 

Figure 4 shows the results of this strategy. We observe that for these three 
decision situations, the execution times fluctuate, showing no regular trend. 
Hence, the number of constraints could hardly impact upon the performance 
of SNOPT according to this strategy. 



Strategy 2 In this strategy, full use is made of N, 2 iV, 31V, and 4 N constraint 
sets, respectively. Each constraint set is applied directly this time, while the 
number of consequences increases from 51 to 250. This experiment applies 
to 25 groups of data. Each group consists of three instances from 51 to 250 
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consequences, respectively. Correspondingly, a total of around 200 x 4 x 25 = 
20000 simulated decision situations are computed. Figure 5 demonstrates the 
experimental results of this strategy. 

Apart from the rise in execution times with the increase in the number 
of consequences, no clear dominance between these four constraint sets could 
be observed. Accordingly, the number of constraints could hardly affect the 
execution time of a general decision situation. 




Fig. 4. Strategy 1 




Fig. 5. Strategy 2 
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3.5 Impacts from Different Combinations 

In this experiment, three strategies representing different combinations of the 
three types of constraints, as shown in Table 2, are taken. For each strategy, 
there are around 2 N constraints. It applies to 25 groups of data. Each group 
consists of instances from 51 to 250 consequences, respectively. Correspond- 
ingly, a total of around 200 x 3 x 25 = 15000 simulated decision situations 
are computed. 



Table 2. Combination Strategies 



Comparative Difference Compound 


Strategy I: 50% 


25% 


25% 


Strategy II: 50% 


50% 


0 


Strategy III: 100% 


0 


0 



Figure 6 demonstrates the results of this simulation study. 




io 




50 lOO 150 200 250 

The number of consequences 



Fig. 6. Various Combinations 



Although, intuitively a difference is supposed to exist, no obvious domi- 
nance could be observed. One reasonable explanation may lie in the 2 normal- 
ization constraints for P-base. Most software packages are able to successfully 
cope with the box constraint for a variable. Nevertheless, none are partic- 
ularly designed to handle the normalization constraints. Not surprisingly, 2 
normalization equations always remain internally as general constraints. Even 
if there were a Strategylll containing 100% comparative statements, 2 nor- 
malization constraints would still make this strategy no different to others 
from a computational viewpoint. 
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According to this experiment, for a general decision situation evaluated 
by the DELTA method, different combinations of three types of constraint 
statements can hardly affect the execution time of SNOPT. 

4 Conclusions and Future Work 

In consistence with the results from the simulation study, the number of 
constraints and different types of constraints barely affect the execution time 
of SNOPT. A large gap exists between BLP and LP algorithms, which makes 
the idea of searching for a fast BLP algorithm possible. The difference between 
PBO and VBO could be a useful research direction to follow. General BLP 
algorithm can not meet the demand of an interactive software package. 

In order to realize the new optimization algorithm, our future research 
work plans to begin with the revised active set method, and to take full 
advantage of the particular structure in (1) combined with certain advanced 
techniques from Sequential Quadratic Programming (SQP), which is adopted 
by the well-known NLP solver SNOPT. 
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Abstract. knowCube is a novel multicriteria decision support system, consisting 
of components for knowledge organization, generation, and navigation. Knowledge 
organization rests upon a data base for managing qualitative and quantitative crite- 
ria, together with add-on information. Knowledge generation serves filling the data 
base via e.g. identification, optimization, classification or simulation. For “finding 
needles in haycocks” , the knowledge navigation component supports graphical data 
base retrieval and interactive, goal-oriented problem solving. Navigation “helpers” 
are, for instance, cascading criteria aggregations, modifiable metrics, ergonomic in- 
terfaces, and customizable visualizations. Examples from real-life projects, e.g. in 
industrial engineering and in the life sciences, illustrate the application of knowCube. 



1 Introduction 

Usually, real-life decision problems are characterized by several criteria or 
objectives to be taken into consideration. Despite the fact that “multiple 
objectives are all around us”, as Zeleny [1] points out, the dissemination of 
methods for multicriteria decision making (MCDM) into practice can still 
be regarded as insufficient. A principal reason for that situation might be 
that practitioners are just not familiar with MCDM methods, which often 
are difficult to understand and to work at. One main difficulty for an easy 
and explorative usage of methods might be caused by the user interface, 
i.e. the handling of interactions with a corresponding computer program. 
Zionts [2] formulates this obvious necessity of user-friendly software as follows: 
“I strongly believe that what is needed is a spreadsheet type of method that 
will allow ordinary people to use MCDM methods for ordinary decisions.” 
knowCube , an innovative multicriteria decision support system (MCDSS), 
mainly originates from focussing on such user-specific needs. Therefore, the 
first aspect of the system is the provision of visualizations and interactivity 
in categories well understandable by non-expert users. All technical stuff, 
necessary for this comfortable presentation of and access on knowledge, is 
hidden in the background, combined in a so-called navigation component. Its 
integration with further components, for generating and managing knowledge 
data required for decision processes, is another main feature of this MCDSS. 

The paper gives a scope of knowCube , the emphasis lies on presenting real 
projects already done. More details are found in Hanne and Trinkaus [3]. 
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2 Knowledge Generation, Organization, Navigation 




Fig. 1. “One picture means more than thousand words” 



The sketch perfectly illustrates the scope of know Cube: A decision maker, 
comfortably interacting (by ear, eye, mouth, or hand) with an MCDSS! 

Looking on the core of a multicriteria decision task, the following cases 
are to distinguish: If the description of the problem is known completely, 
it is called a “white” (box) multicriteria problem - as mostly assumed in 
optimization methods, applied for finding “the best of all possible solutions” . 
If nothing is known about the problem’s structure, it is denoted as “black” . 
Typically, outcomes of such systems are found by trial and error, or won 
by general inquiries - so they are frequently not reproducible or changing 
with time. Most real decision situations however are in between “black or 
white” , leading to “hybrid” problems. Then carrying out costly experiments 
and analyzing the results in combination with simulation methods are the 
means chosen for getting decision suggestions. 

This central part of decision making: generation of knowledge, is highly 
specific, in most cases it must be customized according to the needs of acute 
problem settings. But, the other aspects may and should be supported by 
standardized tools. This was one starting point for the idea of know Cube. 

Seen as a general framework of an MCDSS, it consists of three main com- 
ponents: knowOrg, knowGen, and knowNav (knowledge organization, gener- 
ation, and navigation). These are put together with their sub modules into a 
common box, showing to various decision makers varied views, just like the 
different faces of a cube. This gives a hint at the term “knowledge cube”, 
abbreviated knowCube , taken as a “logo” for the complete MCDSS. Fig. 2 
illustrates its structure, Hanne and Trinkaus [3] give additional technical de- 
tails (especially on knowOrg and knowNav) - and so there’s some place left 
for explaining the more interesting special features of knowCube by two nice 
examples in the following sections. 
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Fig. 2. The Structure of knowCube 



3 Finding an Ideal Radiation Therapy Plan 

Within the complete, time consuming workflow process of intensity mod- 
ulated radiation therapy (IMRT), two challenging tasks emerge: First, the 
segmentation of CT (computer tomography) or MR (magnetic resonance) 
slides, i.e. adding curves onto the slides, describing the boundaries of the 
tumor and the neighboring organs at risk. Second, the dose calculation, i.e. 
computing the dose contributions to each voxel (volume element inside the 
body) of interest, coming from corresponding bixels at the beamheads (beam- 
head pixels) of a linear accelerator, used for the radiation treatment. 

Some output of these two steps is taken as input for the knowledge data 
base: General information concerning the patient to be treated, his/her CT 
or MR slides, the segmentation contours, and the dose matrix. 

Now the optimization procedure, done within the module knowOpt , starts, 
taking about four hours on a PC. It generates up to 1000 distinct Pareto opti- 
mal 3D-solutions, “covering” the planning horizon with a grid of alternatives 
for the patient. Here, a solution assigns a real number to each bixel, rep- 
resenting the amount of radiation emitted from there. The superposition of 
all bixel contributions sums up to a radiation distribution in the volume of 
interest, containing the tumor and the organs at risk. Each of these objects 
obtains a set of “notes” - as e.g. numbers, functions, and point sets - by 
which the decision maker will be able to estimate their “qualities”. (More 
details on IMRT are presented in Bortfeld [4] and Bortfeld et al. [5].) 
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All calculations mentioned above happen automatically, they may be done 
overnight as a batch job, and stored in the data base knowBas. The next day, 
the results may be transferred to a notebook, such that the physician (and 
even his/her patient) may look for the optimal plan interactively. 

And then, managing this enormous quantity of data to find out the “best” 
plan with reasonable effort works by 

• real-time accesses on the pre-calculated and -processed data base - which 
in particular contains various data aggregations in a cascading manner, 

• simultaneous visualizations of dose distributions - by well known (for 
a physician, at least) dose-volume-histograms and colored isodose lines, 
superimposed on the patient’s grey-value CTs or MRs, 

• the tricky exploration tool know Cube Navigator , supporting the interac- 
tive, goal oriented tour through the huge variety of solutions - leading 
towards the patient’s optimal radiation therapy plan within minutes. 

Fig. 3 shows a part of the graphical user interface (GUI) at the beginning 
of a typical planning session, when the main pointer of the database references 
on the solution of least common tolerance - a kind of “average solution” , that 
balances “notes” of conflicting criteria. 




Fig. 3. GUI for IMRT 



Information objects are presented there in a decreasing degree of fineness: 

• “Richest” information is given by stacks of CTs or MRs through the 
neighborhood of the tumor (frontal, sagittal, and transversal - as selected 
here for the sketch), superimposed by in advance calculated isolines. 
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• “Medium” information content is aggregated in the dose-volume his- 
togram, where each curve shows the accumulated Gray contribution per 
organ at risk or tumor. (Gray is the physical unit for radiation energy.) 

• The “coarsest” information is delivered by the navigation object of the 
GUI: All radiation energy absorbed by an organ at risk - or by the tumor 
- is summarized in a corresponding number. These numbers are inscribed 
as pull points (i.e. grip points) on the organs’ or tumor’s acceptance inter- 
vals (i.e. decision ranges), arranged in a star-shaped sketch. Linking these 
grip points by line segments results in a solution polygon (i.e. navigation 
polygon), characterizing the whole planning solution from a top point of 
view, well suited for a first, quick estimate of the solution’s relevance. 

All solutions together define the ranges of the acceptance intervals. Con- 
necting their endpoints delimits the shaded area, called planning horizon 
(i.e. decision range). Navigating happens by a mouse-click on a pull point, 
moving it towards smaller/bigger values. The data base, indexed by modi- 
fied lexicographic ordering strategies, is scanned simultaneously, isolines and 
dose- volume curves of “neighboring-solutions” are updated on the screen at 
once. As the mouse-click is released, the “moving polygon” stops in a new 
position. This first kind of action: pull, may be repeated to explore the plan- 
ning horizon. But, due to Pareto optimality, going to a “better” Gray value 
on some axis must be paid by a “worse” value somewhere else. Here helps a 
second kind of action: lock. Again, only by a mouse-click in a lock-box, the 
planning horizon immediately is divided into differently shaded parts. Active 
navigation is restricted, a filter selects the accessible objects in the data base. 

Some more actions facilitate the physician’s work: storing, viewing and 
skimming, by using well known recorder button functionalities. All of them 
support: Navigating in a planning horizon - towards an optimal solution! 




Fig. 4. A Navigation Tour - One Intermediate Step 
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4 Designing Best Trunking Devices 

An engineering team got the task of designing the profile of a new electrical 
trunking device - a product usually fixed at the wall, and used for comfortable 
laying of multitudes of cables. Many objectives are to be taken into account 
in such a development process. Fig. 5 helps for a better understanding. 



r t 



Fig. 5. Cross Section of a Trunking Device 

r p points to the resistance of the trunking device against pressing from 
opposite sides, r* to its resistance against torsion, and p r denotes the por- 
tion of recycling material (instead of pure PVC). These variables should have 
big values, of course. Together with tb and t s (the thickness of bottom and 
side faces) they characterize the “look and feel” of a specific design variant. 
Another group of variables represents production time, costs, and amount 
of material needed. All these eight variables are “working together” , in non- 
trivial, highly nonlinear, and partially conflicting combinations. (Some more 
technical background may be found in Ebeling [6].) 

After designing plenty of different profile versions, evaluating them virtu- 
ally (e.g. by some finite element methods out of knowSim ), and putting all 
together into the data base, the job of the engineering team is done. Then 
the management has to decide which new profile should be launched - but, 
without looking over hundreds of data sheets. 

Here the component knowNav helps again: A closed polygon within a star- 
shaped scale arrangement visualizes a data base record, i.e. a design variant. 
Other objects (e.g. acceptance intervals, decision horizon) and functionalities 
(e.g. locking, storing) are analogous to the IMRT case. Navigation happens 
via moving the polygon by mouse-clicks, in “extreme” cases also by the CEO. 
So, knowCube serves as an ideal base for discussions at meetings, where many 
decision makers are fighting with plenty, usually conflicting, arguments. 
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Fig. 6. knowCube Navigator 



For this application, Fig. 6 shows some parts of the GUI, Fig. 7 presents 
popup-information, as e.g. the (exaggerated) torsion under a certain force, 
and the material stress visualized by colorings of distinguished profile details. 




Fig. 7. Design of a Trunking Device - Information Attachment 
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5 Summary, Conclusions, and Outlook 

knowCube was introduced, a novel interactive decision support system, inte- 
grating various tools for knowledge organization, generation, and navigation. 

The main guideline for designing knowCube was to have a user-friendly 
visual interface, and to utilize interactivity in terms which are familiar to 
a non-expert decision maker, in particular for an ’’intuitive surfing through 
data bases of alternatives” - according to the already cited statement of 
Stanley Zionts: “I strongly believe that what is needed is a spreadsheet type 
of method that will allow ordinary people to use MCDM methods for ordi- 
nary decisions.” I hope, that knowCube points towards this direction, and 
experiences won by the two application examples already realized in practise 
strongly are confirming this hope. 

This paper was dealing only with quantitative criteria - to keep it simple, 
to introduce the main concepts of knowCube , as a first step, and to have place 
for explaining the basics by examples. 

To work also with other types of criteria - like qualitative, objective or 
subjective, rational or irrational, active or passive, dependent or independent, 
deterministic or statistic, hard or soft, timely, ..., and all mixed together - 
the topics introduced so far must be extended. This will happen in a paper 
to follow. And again, the main new ideas therein will be motivated, guided 
and demonstrated by real-life applications. 
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